Apr 24 16:59:20 devstack cinder-volume[72336]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 16:59:20 devstack cinder-volume[72336]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 16:59:20 devstack cinder-volume[72336]: we strongly recommend against using it for new projects. Apr 24 16:59:20 devstack cinder-volume[72336]: If you are already using Eventlet, we recommend migrating to a different Apr 24 16:59:20 devstack cinder-volume[72336]: framework. For more detail see Apr 24 16:59:20 devstack cinder-volume[72336]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 16:59:20 devstack cinder-volume[72336]: import eventlet # noqa Apr 24 16:59:22 devstack cinder-volume[72336]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72336) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 16:59:22 devstack cinder-volume[72336]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72336) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 16:59:22 devstack cinder-volume[72336]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72336) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 16:59:23 devstack cinder-volume[72336]: INFO dbcounter [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Registered counter for database cinder Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_db.sqlalchemy.engines [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG dbcounter [-] [72336] Writer thread running {{(pid=72336) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 16:59:23 devstack cinder-volume[72336]: INFO cinder.rpc [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 16:59:23 devstack cinder-volume[72336]: INFO cinder.rpc [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_db.sqlalchemy.engines [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 16:59:23 devstack cinder-volume[72336]: INFO cinder.volume.manager [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Determined volume DB was empty at startup. Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG cinder.volume.manager [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72336) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 16:59:23 devstack cinder-volume[72336]: INFO cinder.volume.manager [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 16:59:23 devstack cinder-volume[72336]: WARNING stevedore.named [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 16:59:23 devstack cinder-volume[72336]: WARNING castellan.key_manager [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 16:59:23 devstack cinder-volume[72336]: WARNING cinder.keymgr.conf_key_mgr [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG cinder.volume.drivers.lvm [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72336) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] CMD "cinder-rtstool verify" returned: 0 in 0.279s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_db.sqlalchemy.engines [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 16:59:23 devstack cinder-volume[72336]: INFO cinder.rpc [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 24 16:59:23 devstack cinder-volume[72336]: INFO cinder.rpc [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 24 16:59:23 devstack cinder-volume[72336]: WARNING stevedore.named [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 16:59:23 devstack cinder-volume[72336]: WARNING castellan.key_manager [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 16:59:23 devstack cinder-volume[72336]: INFO cinder.volume.manager [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_db.sqlalchemy.engines [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 16:59:23 devstack cinder-volume[72336]: INFO oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Starting 1 workers Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Started child 72449 {{(pid=72336) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Full set of CONF: {{(pid=72336) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] ******************************************************************************** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Configuration options gathered from: {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] ================================================================================ {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] allow_availability_zone_fallback = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] allow_compression_on_image_upload = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72449]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] allowed_direct_url_schemes = [] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] api_rate_limit = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] auth_strategy = keystone {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] az_cache_duration = 3600 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_availability_zone = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_host = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_name = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_stats_polling_interval = 60 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backup_api_class = cinder.backup.api.API {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backup_name_template = backup-%s {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backup_use_same_host = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backup_use_temp_snapshot = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] chap_password = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] chap_username = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cinder_internal_tenant_project_id = 0cb451c5e89d40268a53c63931b125df {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cinder_internal_tenant_user_id = bea859b9806d416e9d345d5bacfedab7 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cloned_volume_same_az = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cluster = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] compression_format = gzip {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] compute_api_class = cinder.compute.nova.API {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] config_dir = [] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] config_source = [] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] control_exchange = openstack {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] debug = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] default_availability_zone = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] default_group_type = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] default_volume_type = lvmdriver-1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] disk_geometry = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] driver_client_cert = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] driver_client_cert_key = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] driver_data_namespace = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] driver_ssl_cert_path = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] driver_ssl_cert_verify = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] driver_use_ssl = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] enable_force_upload = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] enable_new_services = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] enable_unsupported_driver = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] enforce_multipath_for_image_xfer = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] filter_function = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance_api_insecure = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance_api_servers = ['http://192.168.122.23/image'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance_api_ssl_compression = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance_ca_certificates_file = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance_catalog_info = image:glance:publicURL {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance_certfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance_keyfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance_num_retries = 3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance_request_timeout = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] goodness_function = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] graceful_shutdown_timeout = 5 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] group_api_class = cinder.group.api.API {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] host = devstack {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] image_compress_on_upload = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] image_conversion_address_space_limit = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] image_conversion_cpu_limit = 60 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] image_conversion_disable = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] image_upload_use_cinder_backend = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] image_upload_use_internal_tenant = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] image_volume_cache_enabled = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] image_volume_cache_max_count = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] image_volume_cache_max_size_gb = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] init_host_max_objects_retrieval = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] instance_format = [instance: %(uuid)s] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] iscsi_target_flags = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] iscsi_write_cache = on {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] iser_helper = tgtadm {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] iser_ip_address = 192.168.122.23 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] iser_port = 3260 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] log_color = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] log_config_append = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] log_dir = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] log_file = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] log_options = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] log_rotate_interval = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] log_rotate_interval_type = days {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] log_rotation_type = none {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] max_age = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] max_logfile_count = 30 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] max_logfile_size_mb = 200 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] max_over_subscription_ratio = 20.0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] message_reap_interval = 86400 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72449]: INFO cinder.volume.manager [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] message_ttl = 2592000 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] migration_create_volume_timeout_secs = 300 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] monkey_patch = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] monkey_patch_modules = [] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] my_ip = 192.168.122.23 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] no_snapshot_gb_quota = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] num_iser_scan_tries = 3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] num_shell_tries = 3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] num_volume_device_scan_tries = 3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] nvmeof_conn_info_version = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] nvmet_ns_id = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] nvmet_port_id = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] osapi_max_limit = 1000 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] osapi_volume_ext_list = [] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] osapi_volume_listen_port = 8776 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] osapi_volume_use_ssl = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] osapi_volume_workers = 2 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] per_volume_size_limit = -1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] periodic_fuzzy_delay = 60 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] periodic_interval = 60 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] public_endpoint = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] publish_errors = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] quota_backup_gigabytes = 1000 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] quota_backups = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] quota_gigabytes = 1000 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] quota_groups = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] quota_snapshots = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] quota_volumes = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] rate_limit_burst = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] rate_limit_except_level = CRITICAL {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] rate_limit_interval = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] reinit_driver_count = 3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] replication_device = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] report_discard_supported = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] report_interval = 120 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] reservation_clean_interval = 86400 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] reservation_expire = 86400 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] reserved_image_namespaces = [] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] reserved_percentage = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] rpc_response_timeout = 120 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] run_external_periodic_tasks = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] scst_target_driver = iscsi {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] scst_target_iqn_name = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] service_down_time = 720 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] shell_completion = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] snapshot_name_template = snapshot-%s {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] snapshot_same_host = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] split_loggers = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] state_path = /opt/stack/data/cinder {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] storage_availability_zone = nova {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] storage_protocol = iSCSI {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] syslog_log_facility = LOG_USER {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] target_helper = lioadm {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] target_ip_address = 192.168.122.23 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] target_port = 3260 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] target_protocol = iscsi {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] target_secondary_ip_addresses = [] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] trace_flags = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] transport_url = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] until_refresh = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] use_chap_auth = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] use_default_quota_class = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] use_journal = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] use_json = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] use_multipath_for_image_xfer = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] use_stderr = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] use_syslog = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] verify_glance_signatures = enabled {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_api_class = cinder.volume.api.API {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_backend_name = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_clear = zero {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_clear_ionice = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_clear_size = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_copy_bps_limit = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_dd_blocksize = 1M {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_name_template = volume-%s {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_service_inithost_offload = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volume_usage_audit_period = month {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] zoning_mode = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_concurrency.disable_process_locking = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.admin_password = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.admin_token = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.admin_user = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.auth_port = 35357 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.auth_protocol = https {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.auth_section = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.auth_type = password {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.auth_uri = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.auth_version = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.cache = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.certfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.identity_uri = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.include_service_catalog = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.insecure = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.interface = public {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.keyfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_password = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcache_username = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.region_name = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.service_type = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.backend = dogpile.cache.null {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.backend_argument = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.backend_expiration_time = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.config_prefix = cache.oslo {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.debug_cache_backend = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.enable_retry_client = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.enable_socket_keepalive = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.enabled = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.enforce_fips_mode = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.expiration_time = 600 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.hashclient_retry_attempts = 2 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.memcache_dead_retry = 300 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.memcache_pool_maxsize = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.memcache_sasl_enabled = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.password = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.proxies = [] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.redis_db = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.redis_server = localhost:6379 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.retry_attempts = 2 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.retry_delay = 0.0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.socket_keepalive_count = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.socket_keepalive_idle = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.socket_keepalive_interval = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.socket_timeout = 1.0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.tls_allowed_ciphers = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.tls_cafile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.tls_certfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.tls_enabled = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.tls_keyfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cache.username = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] coordination.backend_url = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.asyncio_connection = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.asyncio_slave_connection = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.backend = sqlalchemy {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.connection = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.connection_debug = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.connection_parameters = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.connection_recycle_time = 3600 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.connection_trace = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.db_inc_retry_interval = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.db_max_retries = 20 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.db_max_retry_interval = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.db_retry_interval = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.max_overflow = 50 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.max_pool_size = 5 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.max_retries = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.mysql_wsrep_sync_wait = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.pool_timeout = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.retry_interval = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.slave_connection = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.sqlite_synchronous = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.synchronous_reader = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] database.use_db_reconnect = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler.connection_string = messaging:// {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler.enabled = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler.es_doc_type = notification {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler.es_scroll_size = 10000 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler.es_scroll_time = 2m {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler.filter_error_trace = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler.hmac_keys = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler.sentinel_service_name = mymaster {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler.socket_timeout = 0.1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler.trace_requests = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler.trace_sqlalchemy = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler_jaeger.process_tags = {} {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler_jaeger.service_name_prefix = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] profiler_otlp.service_name_prefix = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_policy.enforce_new_defaults = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: WARNING oslo_config.cfg [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_policy.enforce_scope = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_policy.policy_default_rule = default {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_policy.policy_file = policy.yaml {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] privsep_osbrick.group = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:23 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] privsep_osbrick.helper_command = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] privsep_osbrick.user = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cinder_sys_admin.group = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cinder_sys_admin.helper_command = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] cinder_sys_admin.user = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] service_user.auth_section = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] service_user.auth_type = password {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] service_user.cafile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] service_user.certfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] service_user.collect_timing = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] service_user.insecure = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] service_user.keyfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] service_user.send_service_user_token = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] service_user.split_loggers = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] service_user.timeout = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance.auth_section = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance.auth_type = password {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance.certfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance.collect_timing = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance.insecure = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance.keyfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance.region_name = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance.split_loggers = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] glance.timeout = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.backend_availability_zone = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.chap_password = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.chap_username = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.disk_geometry = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.driver_client_cert = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.driver_client_cert_key = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.driver_data_namespace = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.driver_use_ssl = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.extra_capabilities = {} {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.filter_function = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.goodness_function = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:24 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.iscsi_target_flags = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.iscsi_write_cache = on {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.iser_helper = tgtadm {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.iser_port = 3260 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.lvm_share_target = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.lvm_type = auto {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.num_shell_tries = 3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.replication_device = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.report_discard_supported = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.reserved_percentage = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.target_helper = tgtadm {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.target_port = 3260 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.target_protocol = iscsi {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.trace_flags = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.unique_fqdn_network = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.use_chap_auth = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.volume_backend_name = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.volume_clear = zero {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.volume_clear_ionice = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.volume_clear_size = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_reports.file_event_handler = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_reports.log_dir = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.backend_host = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.chap_password = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.chap_username = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.disk_geometry = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.driver_client_cert = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.extra_capabilities = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.filter_function = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.goodness_function = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.iser_helper = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.iser_ip_address = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.iser_port = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.lvm_share_target = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.lvm_type = auto {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.num_shell_tries = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.replication_device = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.report_discard_supported = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.reserved_percentage = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.scst_target_driver = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.storage_protocol = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.target_helper = lioadm {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.target_ip_address = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.target_port = 3260 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.trace_flags = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.use_chap_auth = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.volume_clear = zero {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.volume_clear_size = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] lvmdriver-1.volumes_dir = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.ssl = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack sudo[72453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_notifications.driver = [] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_notifications.retry = -1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack sudo[72453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] key_manager.fixed_key = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.barbican_api_version = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.barbican_endpoint = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.barbican_endpoint_type = public {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.barbican_region_name = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.cafile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.certfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.collect_timing = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.insecure = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.keyfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.number_of_retries = 60 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.retry_delay = 1 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.send_service_user_token = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.split_loggers = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.timeout = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.verify_ssl = True {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican.verify_ssl_path = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican_service_user.auth_section = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican_service_user.auth_type = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican_service_user.cafile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican_service_user.certfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican_service_user.collect_timing = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican_service_user.insecure = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican_service_user.keyfile = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican_service_user.split_loggers = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] barbican_service_user.timeout = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vault.approle_role_id = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vault.approle_secret_id = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vault.kv_mountpoint = secret {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vault.kv_path = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vault.kv_version = 2 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vault.namespace = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vault.root_token_id = **** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vault.ssl_ca_crt_file = None {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vault.timeout = 60.0 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vault.use_ssl = False {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 16:59:24 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] ******************************************************************************** {{(pid=72336) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 16:59:24 devstack sudo[72453]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:24 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:24 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:24 devstack sudo[72553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 16:59:24 devstack sudo[72553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:25 devstack sudo[72553]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:25 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.500s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:25 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 16:59:25 devstack cinder-volume[72449]: INFO cinder.brick.local_dev.lvm [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 24 16:59:25 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:25 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:25 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:25 devstack sudo[72779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 16:59:25 devstack sudo[72779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:25 devstack sudo[72779]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:25 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:25 devstack cinder-volume[72449]: DEBUG cinder.brick.local_dev.lvm [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72449) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 24 16:59:25 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:25 devstack sudo[72940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 16:59:25 devstack sudo[72940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:26 devstack sudo[72940]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:26 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.039s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:26 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:26 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:26 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:26 devstack sudo[73092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 16:59:26 devstack sudo[73092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:27 devstack sudo[73092]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:27 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:27 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:27 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:27 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:27 devstack sudo[73141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 24 16:59:27 devstack sudo[73141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:27 devstack sudo[73141]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:27 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.477s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:27 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:27 devstack sudo[73144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 16:59:27 devstack sudo[73144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:28 devstack sudo[73144]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:28 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:28 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:28 devstack sudo[73152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 16:59:28 devstack sudo[73152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:28 devstack sudo[73152]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:28 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:28 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:28 devstack sudo[73156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 16:59:28 devstack sudo[73156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:29 devstack sudo[73156]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:29 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:29 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:29 devstack sudo[73161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 16:59:29 devstack sudo[73161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:29 devstack sudo[73161]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:29 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.462s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:29 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:29 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:29 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:29 devstack sudo[73165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 16:59:29 devstack sudo[73165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:30 devstack sudo[73165]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:30 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:30 devstack cinder-volume[72449]: INFO cinder.volume.drivers.lvm [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 24 16:59:30 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:30 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:30 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:30 devstack sudo[73175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 16:59:30 devstack sudo[73175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:30 devstack sudo[73175]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:30 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.605s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:30 devstack cinder-volume[72449]: DEBUG cinder.volume.drivers.lvm [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Updating volume stats {{(pid=72449) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 16:59:30 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:30 devstack sudo[73290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 16:59:30 devstack sudo[73290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:31 devstack sudo[73290]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:31 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:31 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:31 devstack sudo[73406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 16:59:31 devstack sudo[73406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:31 devstack sudo[73406]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:31 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.511s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:31 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:31 devstack sudo[73434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 16:59:31 devstack sudo[73434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:32 devstack sudo[73434]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:32 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:32 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:32 devstack sudo[73437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 16:59:32 devstack sudo[73437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:32 devstack sudo[73437]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:32 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:32 devstack cinder-volume[72449]: INFO cinder.volume.driver [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Driver hasn't implemented _init_vendor_properties() Apr 24 16:59:32 devstack cinder-volume[72449]: DEBUG cinder.volume.driver [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72449) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 16:59:32 devstack cinder-volume[72449]: DEBUG oslo_db.sqlalchemy.engines [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72449) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 16:59:32 devstack cinder-volume[72449]: DEBUG dbcounter [-] [72449] Writer thread running {{(pid=72449) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 16:59:32 devstack cinder-volume[72449]: DEBUG cinder.db.sqlalchemy.api [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Building query based on filter {{(pid=72449) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 16:59:32 devstack cinder-volume[72449]: DEBUG cinder.image.image_utils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72449) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 16:59:32 devstack cinder-volume[72449]: INFO cinder.keymgr.migration [None req-615d44c1-6591-463e-b1aa-ab3aee47431d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 16:59:32 devstack cinder-volume[72449]: DEBUG cinder.volume.drivers.lvm [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Updating volume stats {{(pid=72449) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 16:59:32 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:32 devstack sudo[73444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 16:59:32 devstack sudo[73444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:33 devstack sudo[73444]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:33 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.515s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:33 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:33 devstack sudo[73448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 16:59:33 devstack sudo[73448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:33 devstack cinder-volume[72336]: DEBUG dbcounter [-] [72336] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72336) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 16:59:33 devstack sudo[73448]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:33 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.535s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:33 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:33 devstack sudo[73452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 16:59:33 devstack sudo[73452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:34 devstack sudo[73452]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:34 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.538s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:34 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:34 devstack sudo[73457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 16:59:34 devstack sudo[73457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:34 devstack sudo[73457]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:34 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.539s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:34 devstack cinder-volume[72449]: DEBUG cinder.manager [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Notifying Schedulers of capabilities ... {{(pid=72449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 16:59:34 devstack cinder-volume[72449]: INFO cinder.volume.manager [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Driver initialization completed successfully. Apr 24 16:59:34 devstack cinder-volume[72449]: INFO cinder.manager [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Initiating service 2 cleanup Apr 24 16:59:34 devstack cinder-volume[72449]: INFO cinder.manager [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Service 2 cleanup completed. Apr 24 16:59:34 devstack cinder-volume[72449]: DEBUG cinder.service [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Creating RPC server for service cinder-volume {{(pid=72449) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 16:59:34 devstack cinder-volume[72449]: DEBUG cinder.service [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72449) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 16:59:35 devstack cinder-volume[72449]: INFO cinder.volume.manager [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 24 16:59:35 devstack cinder-volume[72449]: DEBUG cinder.volume.drivers.lvm [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Updating volume stats {{(pid=72449) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 16:59:35 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:35 devstack sudo[73470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 16:59:35 devstack sudo[73470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:35 devstack sudo[73470]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:35 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:35 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:35 devstack sudo[73473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 16:59:35 devstack sudo[73473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:36 devstack sudo[73473]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:36 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:36 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:36 devstack sudo[73476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 16:59:36 devstack sudo[73476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:36 devstack sudo[73476]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:36 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:36 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 16:59:36 devstack sudo[73533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 16:59:36 devstack sudo[73533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 16:59:36 devstack sudo[73533]: pam_unix(sudo:session): session closed for user root Apr 24 16:59:36 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 16:59:36 devstack cinder-volume[72449]: INFO cinder.volume.manager [None req-7eb80b53-8277-4971-bf38-ee5d68b4dc9f None None] Driver post RPC initialization completed successfully. Apr 24 16:59:46 devstack cinder-volume[72449]: DEBUG dbcounter [-] [72449] Writing DB stats cinder:SELECT=4 {{(pid=72449) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 16:59:46 devstack cinder-volume[72449]: DEBUG dbcounter [-] [72449] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72449) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:01:09 devstack cinder-volume[72449]: DEBUG oslo_service.periodic_task [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:01:09 devstack cinder-volume[72449]: DEBUG cinder.volume.drivers.lvm [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Updating volume stats {{(pid=72449) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 17:01:09 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:01:09 devstack sudo[78541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 17:01:09 devstack sudo[78541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:01:10 devstack sudo[78541]: pam_unix(sudo:session): session closed for user root Apr 24 17:01:10 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:01:10 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:01:10 devstack sudo[78544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 17:01:10 devstack sudo[78544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:01:10 devstack sudo[78544]: pam_unix(sudo:session): session closed for user root Apr 24 17:01:10 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:01:10 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:01:10 devstack sudo[78547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 17:01:10 devstack sudo[78547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:01:11 devstack sudo[78547]: pam_unix(sudo:session): session closed for user root Apr 24 17:01:11 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:01:11 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:01:11 devstack sudo[78553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 17:01:11 devstack sudo[78553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:01:11 devstack sudo[78553]: pam_unix(sudo:session): session closed for user root Apr 24 17:01:11 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:01:11 devstack cinder-volume[72449]: DEBUG cinder.manager [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Notifying Schedulers of capabilities ... {{(pid=72449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:01:46 devstack cinder-volume[72449]: DEBUG dbcounter [-] [72449] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72449) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:02:09 devstack cinder-volume[72449]: DEBUG oslo_service.periodic_task [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:02:09 devstack cinder-volume[72449]: DEBUG cinder.volume.drivers.lvm [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Updating volume stats {{(pid=72449) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 17:02:09 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:02:09 devstack sudo[80355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 17:02:09 devstack sudo[80355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:02:10 devstack sudo[80355]: pam_unix(sudo:session): session closed for user root Apr 24 17:02:10 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:02:10 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:02:10 devstack sudo[80359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 17:02:10 devstack sudo[80359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:02:10 devstack sudo[80359]: pam_unix(sudo:session): session closed for user root Apr 24 17:02:10 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:02:10 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:02:10 devstack sudo[80362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 17:02:10 devstack sudo[80362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:02:11 devstack sudo[80362]: pam_unix(sudo:session): session closed for user root Apr 24 17:02:11 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.460s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:02:11 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:02:11 devstack sudo[80376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 17:02:11 devstack sudo[80376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:02:11 devstack sudo[80376]: pam_unix(sudo:session): session closed for user root Apr 24 17:02:11 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:02:11 devstack cinder-volume[72449]: DEBUG cinder.manager [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Notifying Schedulers of capabilities ... {{(pid=72449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:03:01 devstack cinder-volume[72336]: INFO oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Caught SIGTERM, stopping children Apr 24 17:03:01 devstack cinder-volume[72336]: DEBUG oslo_concurrency.lockutils [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Acquiring lock "singleton_lock" {{(pid=72336) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 17:03:01 devstack cinder-volume[72336]: DEBUG oslo_concurrency.lockutils [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Acquired lock "singleton_lock" {{(pid=72336) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 17:03:01 devstack cinder-volume[72336]: DEBUG oslo_concurrency.lockutils [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Releasing lock "singleton_lock" {{(pid=72336) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 17:03:01 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Stop services. {{(pid=72336) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 17:03:01 devstack cinder-volume[72336]: DEBUG oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Killing children. {{(pid=72336) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 17:03:01 devstack cinder-volume[72336]: INFO oslo_service.backend._eventlet.service [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Waiting on 1 children to exit Apr 24 17:03:06 devstack cinder-volume[72449]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 24 17:03:06 devstack cinder-volume[81404]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 17:03:06 devstack cinder-volume[81404]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 17:03:06 devstack cinder-volume[81404]: we strongly recommend against using it for new projects. Apr 24 17:03:06 devstack cinder-volume[81404]: If you are already using Eventlet, we recommend migrating to a different Apr 24 17:03:06 devstack cinder-volume[81404]: framework. For more detail see Apr 24 17:03:06 devstack cinder-volume[81404]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 17:03:06 devstack cinder-volume[81404]: import eventlet # noqa Apr 24 17:03:08 devstack cinder-volume[81404]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 17:03:08 devstack cinder-volume[81404]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 17:03:08 devstack cinder-volume[81404]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 17:03:09 devstack cinder-volume[81404]: INFO dbcounter [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Registered counter for database cinder Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_db.sqlalchemy.engines [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG dbcounter [-] [81404] Writer thread running {{(pid=81404) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 17:03:09 devstack cinder-volume[81404]: INFO cinder.rpc [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 17:03:09 devstack cinder-volume[81404]: INFO cinder.rpc [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_db.sqlalchemy.engines [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 17:03:09 devstack cinder-volume[81404]: INFO cinder.volume.manager [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Determined volume DB was empty at startup. Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG cinder.volume.manager [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81404) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 17:03:09 devstack cinder-volume[81404]: INFO cinder.volume.manager [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 17:03:09 devstack cinder-volume[81404]: WARNING stevedore.named [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 17:03:09 devstack cinder-volume[81404]: WARNING castellan.key_manager [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 17:03:09 devstack cinder-volume[81404]: WARNING cinder.keymgr.conf_key_mgr [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 17:03:09 devstack cinder-volume[81404]: INFO cinder.volume.manager [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_db.sqlalchemy.engines [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 17:03:09 devstack cinder-volume[81404]: INFO oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Starting 1 workers Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Started child 81522 {{(pid=81404) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Full set of CONF: {{(pid=81404) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] ******************************************************************************** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Configuration options gathered from: {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 17:03:09 devstack cinder-volume[81522]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] ================================================================================ {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] allow_availability_zone_fallback = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] allow_compression_on_image_upload = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] allowed_direct_url_schemes = [] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] api_rate_limit = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] auth_strategy = keystone {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_availability_zone = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_host = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_name = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_stats_polling_interval = 60 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backup_api_class = cinder.backup.api.API {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backup_name_template = backup-%s {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backup_use_same_host = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backup_use_temp_snapshot = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] chap_password = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] chap_username = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cinder_internal_tenant_project_id = 0cb451c5e89d40268a53c63931b125df {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cinder_internal_tenant_user_id = bea859b9806d416e9d345d5bacfedab7 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cluster = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] compression_format = gzip {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] compute_api_class = cinder.compute.nova.API {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] config_dir = [] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] config_source = [] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] control_exchange = openstack {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] debug = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] default_availability_zone = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] default_group_type = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 17:03:09 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.remotefs [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81522) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] default_volume_type = QuobyteHD {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] disk_geometry = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] driver_client_cert = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] driver_client_cert_key = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] driver_data_namespace = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[72449]: DEBUG oslo_service.periodic_task [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72449) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:03:09 devstack cinder-volume[72449]: DEBUG cinder.volume.drivers.lvm [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Updating volume stats {{(pid=72449) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] driver_ssl_cert_path = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] driver_ssl_cert_verify = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] driver_use_ssl = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] enable_new_services = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] enable_unsupported_driver = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] enabled_backends = ['QuobyteHD'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] enforce_multipath_for_image_xfer = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] filter_function = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance_api_insecure = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance_api_servers = ['http://192.168.122.23/image'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance_api_ssl_compression = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance_ca_certificates_file = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance_catalog_info = image:glance:publicURL {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance_certfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance_keyfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance_num_retries = 3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance_request_timeout = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] goodness_function = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] graceful_shutdown_timeout = 5 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] group_api_class = cinder.group.api.API {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] host = devstack {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] image_compress_on_upload = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] image_conversion_address_space_limit = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] image_conversion_cpu_limit = 60 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] image_conversion_disable = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] image_upload_use_cinder_backend = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] image_upload_use_internal_tenant = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] image_volume_cache_enabled = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] image_volume_cache_max_count = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] image_volume_cache_max_size_gb = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:09 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] init_host_max_objects_retrieval = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] instance_format = [instance: %(uuid)s] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] iscsi_target_flags = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] iscsi_write_cache = on {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] iser_helper = tgtadm {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] iser_ip_address = 192.168.122.23 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] iser_port = 3260 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] log_color = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] log_config_append = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] log_dir = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] log_file = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] log_options = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] log_rotate_interval = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] log_rotate_interval_type = days {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] log_rotation_type = none {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack sudo[81523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 17:03:10 devstack sudo[81523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] max_age = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] max_logfile_count = 30 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] max_logfile_size_mb = 200 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] max_over_subscription_ratio = 20.0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] message_reap_interval = 86400 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] message_ttl = 2592000 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] migration_create_volume_timeout_secs = 300 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] monkey_patch = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] monkey_patch_modules = [] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] my_ip = 192.168.122.23 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] no_snapshot_gb_quota = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] num_iser_scan_tries = 3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] num_shell_tries = 3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] num_volume_device_scan_tries = 3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] nvmeof_conn_info_version = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] nvmet_ns_id = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] nvmet_port_id = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] osapi_max_limit = 1000 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] osapi_volume_ext_list = [] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] osapi_volume_listen_port = 8776 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] osapi_volume_use_ssl = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] osapi_volume_workers = 2 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] per_volume_size_limit = -1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] periodic_fuzzy_delay = 60 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] periodic_interval = 60 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] public_endpoint = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] publish_errors = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] quota_backup_gigabytes = 1000 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] quota_backups = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] quota_gigabytes = 1000 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] quota_groups = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] quota_snapshots = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] quota_volumes = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] rate_limit_burst = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] rate_limit_except_level = CRITICAL {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] rate_limit_interval = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] reinit_driver_count = 3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81522) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] replication_device = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.quobyte [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 17:03:10 devstack cinder-volume[81522]: WARNING cinder.volume.drivers.quobyte [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] report_discard_supported = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] report_interval = 120 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] reservation_clean_interval = 86400 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] reservation_expire = 86400 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Running cmd (subprocess): mount.quobyte {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] reserved_image_namespaces = [] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] reserved_percentage = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] rpc_response_timeout = 120 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] run_external_periodic_tasks = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] scst_target_driver = iscsi {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] scst_target_iqn_name = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] service_down_time = 720 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] shell_completion = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] snapshot_name_template = snapshot-%s {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] split_loggers = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] state_path = /opt/stack/data/cinder {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] storage_availability_zone = nova {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] storage_protocol = iSCSI {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] syslog_log_facility = LOG_USER {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] target_helper = lioadm {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] target_ip_address = 192.168.122.23 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] target_port = 3260 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] target_protocol = iscsi {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] target_secondary_ip_addresses = [] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] trace_flags = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] transport_url = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] until_refresh = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] use_chap_auth = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] use_default_quota_class = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] use_journal = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] use_json = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] use_multipath_for_image_xfer = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] use_stderr = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] use_syslog = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] verify_glance_signatures = enabled {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_api_class = cinder.volume.api.API {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_backend_name = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_clear = zero {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_clear_ionice = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_clear_size = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_copy_bps_limit = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_dd_blocksize = 1M {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_name_template = volume-%s {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_service_inithost_offload = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volume_usage_audit_period = month {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] zoning_mode = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_concurrency.disable_process_locking = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.admin_password = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.admin_token = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.admin_user = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.auth_port = 35357 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.auth_protocol = https {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.auth_section = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.auth_type = password {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.auth_uri = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.auth_version = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.cache = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.certfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.identity_uri = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.include_service_catalog = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.insecure = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.interface = public {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.keyfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_password = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcache_username = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.region_name = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.service_type = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.backend = dogpile.cache.null {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.backend_argument = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.backend_expiration_time = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.config_prefix = cache.oslo {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.debug_cache_backend = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.enable_retry_client = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.enable_socket_keepalive = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.enabled = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.enforce_fips_mode = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.expiration_time = 600 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.hashclient_retry_attempts = 2 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.memcache_dead_retry = 300 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.memcache_pool_maxsize = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.memcache_sasl_enabled = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.password = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.proxies = [] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.redis_db = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.redis_server = localhost:6379 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.retry_attempts = 2 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.retry_delay = 0.0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.socket_keepalive_count = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.socket_keepalive_idle = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.socket_keepalive_interval = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.socket_timeout = 1.0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.tls_allowed_ciphers = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.tls_cafile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.tls_certfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack quobyte-client[81525]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 17:03:10 devstack quobyte-client[81525]: Invalid parameters found, error: missing mount point. Apr 24 17:03:10 devstack quobyte-client[81525]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 17:03:10 devstack quobyte-client[81525]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.tls_enabled = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.tls_keyfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cache.username = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] coordination.backend_url = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.asyncio_connection = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.asyncio_slave_connection = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.backend = sqlalchemy {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.connection = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.connection_debug = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.connection_parameters = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.connection_recycle_time = 3600 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.connection_trace = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.db_inc_retry_interval = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.db_max_retries = 20 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.db_max_retry_interval = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.db_retry_interval = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.max_overflow = 50 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.max_pool_size = 5 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.max_retries = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] CMD "mount.quobyte" returned: 1 in 0.117s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:03:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:03:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:03:10 devstack cinder-volume[81522]: INFO cinder.volume.drivers.quobyte [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 ... Apr 24 17:03:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a -c /etc/quobyte/client-cinder.cfg {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.mysql_wsrep_sync_wait = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.pool_timeout = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.retry_interval = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.slave_connection = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.sqlite_synchronous = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.synchronous_reader = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] database.use_db_reconnect = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler.connection_string = messaging:// {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler.enabled = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler.es_doc_type = notification {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler.es_scroll_size = 10000 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler.es_scroll_time = 2m {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler.filter_error_trace = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler.hmac_keys = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler.sentinel_service_name = mymaster {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler.socket_timeout = 0.1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler.trace_requests = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler.trace_sqlalchemy = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler_jaeger.process_tags = {} {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler_jaeger.service_name_prefix = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] profiler_otlp.service_name_prefix = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_policy.enforce_new_defaults = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: WARNING oslo_config.cfg [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_policy.enforce_scope = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_policy.policy_default_rule = default {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_policy.policy_file = policy.yaml {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] privsep_osbrick.group = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] privsep_osbrick.helper_command = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] privsep_osbrick.user = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cinder_sys_admin.group = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cinder_sys_admin.helper_command = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] cinder_sys_admin.user = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] service_user.auth_section = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] service_user.auth_type = password {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] service_user.cafile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] service_user.certfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] service_user.collect_timing = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] service_user.insecure = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] service_user.keyfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] service_user.send_service_user_token = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] service_user.split_loggers = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] service_user.timeout = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance.auth_section = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance.auth_type = password {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance.certfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance.collect_timing = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance.insecure = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance.keyfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance.region_name = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance.split_loggers = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] glance.timeout = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.backend_availability_zone = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.chap_password = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.chap_username = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.disk_geometry = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.driver_client_cert = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.driver_client_cert_key = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.driver_data_namespace = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.driver_use_ssl = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.extra_capabilities = {} {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.filter_function = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.goodness_function = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.iscsi_target_flags = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.iscsi_write_cache = on {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.iser_helper = tgtadm {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.iser_port = 3260 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nas_host = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nas_login = admin {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nas_mount_options = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nas_password = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nas_private_key = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nas_share_path = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.num_shell_tries = 3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.quobyte_volume_url = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.replication_device = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.report_discard_supported = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.reserved_percentage = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.target_helper = tgtadm {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.target_port = 3260 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.target_protocol = iscsi {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.trace_flags = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.unique_fqdn_network = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.use_chap_auth = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.volume_backend_name = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.volume_clear = zero {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.volume_clear_ionice = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.volume_clear_size = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_reports.file_event_handler = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_reports.log_dir = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.backend_availability_zone = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.backend_host = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.chap_password = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.chap_username = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.chiscsi_conf = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.disk_geometry = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.driver_client_cert = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.driver_data_namespace = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.driver_use_ssl = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.extra_capabilities = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.filter_function = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.goodness_function = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.iser_helper = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.iser_ip_address = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.iser_port = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.iser_target_prefix = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nas_host = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nas_login = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nas_mount_options = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack sudo[81526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a -c /etc/quobyte/client-cinder.cfg Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nas_password = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nas_private_key = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack sudo[81526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nas_share_path = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nas_ssh_port = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.num_shell_tries = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.nvmet_port_id = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.replication_device = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.report_discard_supported = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.reserved_percentage = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.scst_target_driver = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.storage_protocol = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.target_helper = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.target_ip_address = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.target_port = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.target_prefix = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.target_protocol = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.trace_flags = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.use_chap_auth = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.volume_clear = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.volume_clear_size = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] QuobyteHD.volumes_dir = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.ssl = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_notifications.driver = [] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_notifications.retry = -1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] key_manager.fixed_key = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.barbican_api_version = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.barbican_endpoint = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.barbican_endpoint_type = public {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.barbican_region_name = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.cafile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.certfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.collect_timing = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.insecure = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.keyfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.number_of_retries = 60 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.retry_delay = 1 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.send_service_user_token = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.split_loggers = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.timeout = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.verify_ssl = True {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican.verify_ssl_path = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican_service_user.auth_section = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican_service_user.auth_type = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican_service_user.cafile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican_service_user.certfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican_service_user.collect_timing = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican_service_user.insecure = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican_service_user.keyfile = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican_service_user.split_loggers = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] barbican_service_user.timeout = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vault.approle_role_id = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vault.approle_secret_id = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vault.kv_mountpoint = secret {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vault.kv_path = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vault.kv_version = 2 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vault.namespace = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vault.root_token_id = **** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vault.ssl_ca_crt_file = None {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vault.timeout = 60.0 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vault.use_ssl = False {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:10 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] ******************************************************************************** {{(pid=81404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 17:03:10 devstack sudo[81523]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:10 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:10 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:10 devstack sudo[81529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 17:03:10 devstack sudo[81529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:10 devstack sudo[81526]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.655s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:10 devstack cinder-volume[81522]: INFO cinder.volume.drivers.quobyte [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 succeeded Apr 24 17:03:10 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:03:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.666s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:03:10 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:10 devstack sudo[81598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:03:10 devstack sudo[81598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:11 devstack sudo[81529]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:11 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:11 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:11 devstack sudo[81601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 17:03:11 devstack sudo[81601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:11 devstack sudo[81598]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.415s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:11 devstack cinder-volume[81522]: INFO cinder.volume.driver [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Driver hasn't implemented _init_vendor_properties() Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG cinder.volume.driver [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81522) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG oslo_db.sqlalchemy.engines [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81522) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG dbcounter [-] [81522] Writer thread running {{(pid=81522) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG cinder.db.sqlalchemy.api [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Building query based on filter {{(pid=81522) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG cinder.image.image_utils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81522) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 17:03:11 devstack cinder-volume[81522]: INFO cinder.keymgr.migration [None req-3efcbce9-52b3-40c4-8a90-6c8263863656 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:11 devstack sudo[81604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:03:11 devstack sudo[81604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:11 devstack sudo[81601]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:11 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:11 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:11 devstack sudo[81609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 17:03:11 devstack sudo[81609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:11 devstack sudo[81604]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.538s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:03:11 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Driver initialization completed successfully. Apr 24 17:03:11 devstack cinder-volume[81522]: INFO cinder.manager [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Initiating service 3 cleanup Apr 24 17:03:11 devstack cinder-volume[81522]: INFO cinder.manager [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Service 3 cleanup completed. Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG cinder.service [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Creating RPC server for service cinder-volume {{(pid=81522) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 17:03:11 devstack cinder-volume[81522]: DEBUG cinder.service [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81522) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 17:03:12 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 17:03:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:03:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:03:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:03:12 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:03:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:03:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:12 devstack sudo[81614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:03:12 devstack sudo[81614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:12 devstack sudo[81609]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:12 devstack cinder-volume[72449]: DEBUG oslo_concurrency.processutils [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.830s {{(pid=72449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:12 devstack cinder-volume[72449]: DEBUG cinder.manager [None req-5e45edd0-0b7d-42a2-966f-b4169fd1ed57 None None] Notifying Schedulers of capabilities ... {{(pid=72449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:03:12 devstack cinder-volume[72449]: DEBUG oslo_concurrency.lockutils [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Acquiring lock "singleton_lock" {{(pid=72449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 17:03:12 devstack cinder-volume[72449]: DEBUG oslo_concurrency.lockutils [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Acquired lock "singleton_lock" {{(pid=72449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 17:03:12 devstack cinder-volume[72449]: DEBUG oslo_concurrency.lockutils [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Releasing lock "singleton_lock" {{(pid=72449) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 17:03:12 devstack cinder-volume[72449]: WARNING amqp [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 17:03:12 devstack cinder-volume[72449]: WARNING amqp [None req-1681116b-3dc5-4fc2-9ba6-d7c7d27ee5b8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 17:03:12 devstack sudo[81614]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:12 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.639s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:12 devstack cinder-volume[81522]: INFO cinder.volume.manager [None req-0d63b328-4db2-4903-9e71-ab29b24c621a None None] Driver post RPC initialization completed successfully. Apr 24 17:03:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-03de567c-965b-4271-a22f-733866166013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:03:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-03de567c-965b-4271-a22f-733866166013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:03:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-03de567c-965b-4271-a22f-733866166013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:03:16 devstack cinder-volume[81522]: DEBUG cinder.volume.drivers.quobyte [None req-03de567c-965b-4271-a22f-733866166013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:03:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-03de567c-965b-4271-a22f-733866166013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81522) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:03:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-03de567c-965b-4271-a22f-733866166013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:16 devstack sudo[81783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:03:16 devstack sudo[81783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:16 devstack cinder-volume[81404]: INFO oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Caught SIGTERM, stopping children Apr 24 17:03:16 devstack cinder-volume[81404]: DEBUG oslo_concurrency.lockutils [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Acquiring lock "singleton_lock" {{(pid=81404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 17:03:16 devstack cinder-volume[81404]: DEBUG oslo_concurrency.lockutils [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Acquired lock "singleton_lock" {{(pid=81404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 17:03:16 devstack cinder-volume[81404]: DEBUG oslo_concurrency.lockutils [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Releasing lock "singleton_lock" {{(pid=81404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 17:03:16 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Stop services. {{(pid=81404) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 17:03:16 devstack cinder-volume[81404]: DEBUG oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Killing children. {{(pid=81404) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 17:03:16 devstack cinder-volume[81404]: INFO oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Waiting on 1 children to exit Apr 24 17:03:16 devstack sudo[81783]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:16 devstack cinder-volume[81522]: DEBUG oslo_concurrency.processutils [None req-03de567c-965b-4271-a22f-733866166013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.766s {{(pid=81522) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:16 devstack cinder-volume[81522]: DEBUG cinder.manager [None req-03de567c-965b-4271-a22f-733866166013 None None] Notifying Schedulers of capabilities ... {{(pid=81522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo.messaging._drivers.impl_rabbit [None req-03de567c-965b-4271-a22f-733866166013 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo.messaging._drivers.impl_rabbit [None req-03de567c-965b-4271-a22f-733866166013 None None] Unable to connect to AMQP server on 192.168.122.23:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server [None req-03de567c-965b-4271-a22f-733866166013 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.23:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 558, in _ensured Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 641, in __call__ Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server method() Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server self._producer.publish( Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server return _publish( Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server listener(*args) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server raise error_for_code( Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.23:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 24 17:03:16 devstack cinder-volume[81522]: ERROR oslo_messaging.rpc.server Apr 24 17:03:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Acquiring lock "singleton_lock" {{(pid=81522) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 17:03:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Acquired lock "singleton_lock" {{(pid=81522) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 17:03:20 devstack cinder-volume[81522]: DEBUG oslo_concurrency.lockutils [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Releasing lock "singleton_lock" {{(pid=81522) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 17:03:20 devstack cinder-volume[81522]: WARNING amqp [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 17:03:20 devstack cinder-volume[81522]: WARNING amqp [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 17:03:20 devstack cinder-volume[81404]: INFO oslo_service.backend._eventlet.service [None req-51490b28-e893-48d0-a7ba-f339ad94df09 None None] Child 81522 exited with status 0 Apr 24 17:03:20 devstack cinder-volume[81813]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 17:03:20 devstack cinder-volume[81813]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 17:03:20 devstack cinder-volume[81813]: we strongly recommend against using it for new projects. Apr 24 17:03:20 devstack cinder-volume[81813]: If you are already using Eventlet, we recommend migrating to a different Apr 24 17:03:20 devstack cinder-volume[81813]: framework. For more detail see Apr 24 17:03:20 devstack cinder-volume[81813]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 17:03:20 devstack cinder-volume[81813]: import eventlet # noqa Apr 24 17:03:22 devstack cinder-volume[81813]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 17:03:22 devstack cinder-volume[81813]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 17:03:22 devstack cinder-volume[81813]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81813) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 17:03:22 devstack cinder-volume[81813]: INFO dbcounter [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Registered counter for database cinder Apr 24 17:03:22 devstack cinder-volume[81813]: DEBUG oslo_db.sqlalchemy.engines [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81813) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG dbcounter [-] [81813] Writer thread running {{(pid=81813) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 17:03:23 devstack cinder-volume[81813]: INFO cinder.rpc [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 17:03:23 devstack cinder-volume[81813]: INFO cinder.rpc [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_db.sqlalchemy.engines [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81813) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 17:03:23 devstack cinder-volume[81813]: INFO cinder.volume.manager [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Determined volume DB was empty at startup. Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG cinder.volume.manager [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81813) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 17:03:23 devstack cinder-volume[81813]: WARNING stevedore.named [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 17:03:23 devstack cinder-volume[81813]: WARNING castellan.key_manager [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 17:03:23 devstack cinder-volume[81813]: WARNING cinder.keymgr.conf_key_mgr [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 17:03:23 devstack cinder-volume[81813]: INFO cinder.volume.manager [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_db.sqlalchemy.engines [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81813) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 17:03:23 devstack cinder-volume[81813]: INFO oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Starting 1 workers Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Started child 81986 {{(pid=81813) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Full set of CONF: {{(pid=81813) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] ******************************************************************************** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Configuration options gathered from: {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 17:03:23 devstack cinder-volume[81986]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] ================================================================================ {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] allow_availability_zone_fallback = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] allow_compression_on_image_upload = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] allowed_direct_url_schemes = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] api_rate_limit = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] auth_strategy = keystone {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_availability_zone = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_host = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_stats_polling_interval = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backup_api_class = cinder.backup.api.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backup_name_template = backup-%s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backup_use_same_host = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backup_use_temp_snapshot = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] chap_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] chap_username = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cinder_internal_tenant_project_id = 0cb451c5e89d40268a53c63931b125df {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cinder_internal_tenant_user_id = bea859b9806d416e9d345d5bacfedab7 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cluster = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] compression_format = gzip {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] compute_api_class = cinder.compute.nova.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] config_dir = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] config_source = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] control_exchange = openstack {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] debug = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] default_availability_zone = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] default_group_type = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] default_volume_type = QuobyteHD {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] disk_geometry = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] driver_client_cert = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] driver_client_cert_key = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] driver_data_namespace = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] driver_ssl_cert_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] driver_ssl_cert_verify = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] driver_use_ssl = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] enable_new_services = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] enable_unsupported_driver = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] enabled_backends = ['QuobyteHD'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] enforce_multipath_for_image_xfer = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] filter_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance_api_insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance_api_servers = ['http://192.168.122.23/image'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance_api_ssl_compression = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance_ca_certificates_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance_catalog_info = image:glance:publicURL {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance_certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance_keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance_num_retries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance_request_timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] goodness_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] graceful_shutdown_timeout = 5 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] group_api_class = cinder.group.api.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] host = devstack {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] image_compress_on_upload = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] image_conversion_address_space_limit = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] image_conversion_cpu_limit = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] image_conversion_disable = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] image_upload_use_cinder_backend = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] image_upload_use_internal_tenant = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] image_volume_cache_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] image_volume_cache_max_count = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] image_volume_cache_max_size_gb = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] init_host_max_objects_retrieval = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] instance_format = [instance: %(uuid)s] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] iscsi_target_flags = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] iscsi_write_cache = on {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] iser_helper = tgtadm {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] iser_ip_address = 192.168.122.23 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] iser_port = 3260 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] log_color = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] log_config_append = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] log_dir = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] log_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] log_options = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] log_rotate_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] log_rotate_interval_type = days {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] log_rotation_type = none {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81986) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] max_age = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] max_logfile_count = 30 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] max_logfile_size_mb = 200 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] max_over_subscription_ratio = 20.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] message_reap_interval = 86400 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] message_ttl = 2592000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] migration_create_volume_timeout_secs = 300 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] monkey_patch = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] monkey_patch_modules = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] my_ip = 192.168.122.23 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] no_snapshot_gb_quota = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] num_iser_scan_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] num_shell_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] num_volume_device_scan_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] nvmeof_conn_info_version = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] nvmet_ns_id = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] nvmet_port_id = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] osapi_max_limit = 1000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] osapi_volume_ext_list = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] osapi_volume_listen_port = 8776 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] osapi_volume_use_ssl = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] osapi_volume_workers = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] per_volume_size_limit = -1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] periodic_fuzzy_delay = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] periodic_interval = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] public_endpoint = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] publish_errors = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] quota_backup_gigabytes = 1000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] quota_backups = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] quota_gigabytes = 1000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] quota_groups = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] quota_snapshots = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] quota_volumes = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] rate_limit_burst = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] rate_limit_except_level = CRITICAL {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] rate_limit_interval = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] reinit_driver_count = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] replication_device = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] report_discard_supported = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] report_interval = 120 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] reservation_clean_interval = 86400 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] reservation_expire = 86400 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] reserved_image_namespaces = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] reserved_percentage = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] rpc_response_timeout = 120 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] run_external_periodic_tasks = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] scst_target_driver = iscsi {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] scst_target_iqn_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] service_down_time = 720 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] shell_completion = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] snapshot_name_template = snapshot-%s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] split_loggers = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] state_path = /opt/stack/data/cinder {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] storage_availability_zone = nova {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] storage_protocol = iSCSI {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] syslog_log_facility = LOG_USER {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] target_helper = lioadm {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] target_ip_address = 192.168.122.23 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] target_port = 3260 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] target_protocol = iscsi {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] target_secondary_ip_addresses = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] trace_flags = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] transport_url = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] until_refresh = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] use_chap_auth = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] use_default_quota_class = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] use_journal = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] use_json = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] use_multipath_for_image_xfer = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] use_stderr = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] use_syslog = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] verify_glance_signatures = enabled {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_api_class = cinder.volume.api.API {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_backend_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_clear = zero {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_clear_ionice = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_clear_size = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_copy_bps_limit = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_dd_blocksize = 1M {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_name_template = volume-%s {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_service_inithost_offload = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volume_usage_audit_period = month {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] zoning_mode = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_concurrency.disable_process_locking = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.admin_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.admin_token = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.admin_user = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.auth_port = 35357 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.auth_protocol = https {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.auth_section = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.auth_type = password {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.auth_uri = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.auth_version = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.cache = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.identity_uri = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.include_service_catalog = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.interface = public {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_password = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcache_username = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.region_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.service_type = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.backend = dogpile.cache.null {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.backend_argument = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.backend_expiration_time = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.config_prefix = cache.oslo {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.debug_cache_backend = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.enable_retry_client = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.enable_socket_keepalive = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.enforce_fips_mode = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.expiration_time = 600 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.hashclient_retry_attempts = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81986) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 17:03:23 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.quobyte [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.memcache_dead_retry = 300 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.memcache_pool_maxsize = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.memcache_sasl_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.quobyte [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.proxies = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.redis_db = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Running cmd (subprocess): mount.quobyte {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.redis_server = localhost:6379 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.retry_attempts = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.retry_delay = 0.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.socket_keepalive_count = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.socket_keepalive_idle = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.socket_keepalive_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.socket_timeout = 1.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.tls_allowed_ciphers = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.tls_cafile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.tls_certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.tls_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.tls_keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cache.username = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] coordination.backend_url = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.asyncio_connection = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.asyncio_slave_connection = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.backend = sqlalchemy {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.connection = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.connection_debug = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.connection_parameters = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.connection_recycle_time = 3600 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.connection_trace = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.db_inc_retry_interval = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.db_max_retries = 20 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.db_max_retry_interval = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.db_retry_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.max_overflow = 50 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.max_pool_size = 5 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.max_retries = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.mysql_wsrep_sync_wait = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.pool_timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.retry_interval = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.slave_connection = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.sqlite_synchronous = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.synchronous_reader = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] database.use_db_reconnect = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler.connection_string = messaging:// {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler.enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler.es_doc_type = notification {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler.es_scroll_size = 10000 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler.es_scroll_time = 2m {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler.filter_error_trace = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler.hmac_keys = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler.sentinel_service_name = mymaster {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler.socket_timeout = 0.1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler.trace_requests = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler.trace_sqlalchemy = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler_jaeger.process_tags = {} {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler_jaeger.service_name_prefix = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] profiler_otlp.service_name_prefix = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_policy.enforce_new_defaults = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: WARNING oslo_config.cfg [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_policy.enforce_scope = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_policy.policy_default_rule = default {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_policy.policy_file = policy.yaml {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] privsep_osbrick.group = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] privsep_osbrick.helper_command = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] privsep_osbrick.user = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cinder_sys_admin.group = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cinder_sys_admin.helper_command = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] cinder_sys_admin.user = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] service_user.auth_section = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] service_user.auth_type = password {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] service_user.cafile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] service_user.certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] service_user.collect_timing = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] service_user.insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] service_user.keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] service_user.send_service_user_token = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] service_user.split_loggers = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] service_user.timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance.auth_section = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance.auth_type = password {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance.certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance.collect_timing = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance.insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance.keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance.region_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance.split_loggers = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] glance.timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.backend_availability_zone = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.chap_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.chap_username = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.disk_geometry = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.driver_client_cert = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.driver_client_cert_key = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.driver_data_namespace = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.driver_use_ssl = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.extra_capabilities = {} {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.filter_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.goodness_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.iscsi_target_flags = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.iscsi_write_cache = on {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.iser_helper = tgtadm {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.iser_port = 3260 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nas_host = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nas_login = admin {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nas_mount_options = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nas_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nas_private_key = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nas_share_path = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.num_shell_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.quobyte_volume_url = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.replication_device = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.report_discard_supported = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.reserved_percentage = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.target_helper = tgtadm {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.target_port = 3260 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack quobyte-client[82008]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.target_protocol = iscsi {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.trace_flags = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.unique_fqdn_network = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.use_chap_auth = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack quobyte-client[82008]: Invalid parameters found, error: missing mount point. Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.volume_backend_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.volume_clear = zero {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.volume_clear_ionice = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.volume_clear_size = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack quobyte-client[82008]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_reports.file_event_handler = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack quobyte-client[82008]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_reports.log_dir = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.backend_availability_zone = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.backend_host = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.chap_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.chap_username = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.chiscsi_conf = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.disk_geometry = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.driver_client_cert = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.driver_data_namespace = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.driver_use_ssl = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.extra_capabilities = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.filter_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.goodness_function = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.iser_helper = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.iser_ip_address = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.iser_port = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.iser_target_prefix = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nas_host = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nas_login = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nas_mount_options = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nas_password = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nas_private_key = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nas_share_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nas_ssh_port = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.num_shell_tries = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.nvmet_port_id = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.replication_device = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.report_discard_supported = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.reserved_percentage = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.scst_target_driver = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.storage_protocol = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.target_helper = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.target_ip_address = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.target_port = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.target_prefix = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.target_protocol = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.trace_flags = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.use_chap_auth = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.volume_clear = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.volume_clear_size = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] QuobyteHD.volumes_dir = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack sudo[82012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack sudo[82012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.ssl = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_notifications.driver = [] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_notifications.retry = -1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] key_manager.fixed_key = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.barbican_api_version = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.barbican_endpoint = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.barbican_endpoint_type = public {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.barbican_region_name = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.cafile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.collect_timing = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.number_of_retries = 60 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.retry_delay = 1 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.send_service_user_token = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.split_loggers = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.verify_ssl = True {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican.verify_ssl_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican_service_user.auth_section = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican_service_user.auth_type = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican_service_user.cafile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican_service_user.certfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican_service_user.collect_timing = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican_service_user.insecure = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican_service_user.keyfile = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican_service_user.split_loggers = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] barbican_service_user.timeout = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vault.approle_role_id = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vault.approle_secret_id = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vault.kv_mountpoint = secret {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vault.kv_path = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vault.kv_version = 2 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vault.namespace = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vault.root_token_id = **** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vault.ssl_ca_crt_file = None {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vault.timeout = 60.0 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vault.use_ssl = False {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 17:03:23 devstack cinder-volume[81813]: DEBUG oslo_service.backend._eventlet.service [None req-f2cd751d-6986-4eb2-aa14-cbcaca857a72 None None] ******************************************************************************** {{(pid=81813) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 17:03:23 devstack sudo[82012]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.434s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:23 devstack cinder-volume[81986]: INFO cinder.volume.driver [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Driver hasn't implemented _init_vendor_properties() Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG cinder.volume.driver [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81986) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_db.sqlalchemy.engines [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81986) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writer thread running {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG cinder.db.sqlalchemy.api [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Building query based on filter {{(pid=81986) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81986) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:03:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:23 devstack cinder-volume[81986]: INFO cinder.keymgr.migration [None req-ff892544-9bb8-48fa-9357-ed6ab573c191 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 17:03:23 devstack sudo[82037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:03:23 devstack sudo[82037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:24 devstack sudo[82037]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.416s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:24 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:03:24 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Driver initialization completed successfully. Apr 24 17:03:24 devstack cinder-volume[81986]: INFO cinder.manager [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Initiating service 3 cleanup Apr 24 17:03:24 devstack cinder-volume[81986]: INFO cinder.manager [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Service 3 cleanup completed. Apr 24 17:03:24 devstack cinder-volume[81986]: DEBUG cinder.service [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Creating RPC server for service cinder-volume {{(pid=81986) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 17:03:24 devstack cinder-volume[81986]: DEBUG cinder.service [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81986) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 17:03:24 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 17:03:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:03:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:03:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:03:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:03:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:03:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:03:24 devstack sudo[82047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:03:24 devstack sudo[82047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:03:24 devstack sudo[82047]: pam_unix(sudo:session): session closed for user root Apr 24 17:03:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.440s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:03:24 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f21b7a5a-cd77-41fd-a9b7-8098298abf32 None None] Driver post RPC initialization completed successfully. Apr 24 17:03:33 devstack cinder-volume[81813]: DEBUG dbcounter [-] [81813] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81813) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:03:33 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:03:34 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=4 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Flow 'volume_create_manager' (5bf11af5-879e-4849-9bc9-1ec3ad33db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06f3206-37de-466d-883f-570dbe91b6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06f3206-37de-466d-883f-570dbe91b6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1502699216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7cf492-2555-458c-9e64-07a7665950d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11a33ca500047bfbd2c6a4b14dde9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:04:51Z,use_quota=True,user_id='55cf7d8fc7644f4092b8c04a271acf92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39898f05-5a88-46e0-ae90-b6109577892d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39898f05-5a88-46e0-ae90-b6109577892d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85fdd2e-6498-44a3-9c25-c70d94a92a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85fdd2e-6498-44a3-9c25-c70d94a92a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7cf492-2555-458c-9e64-07a7665950d6', 'volume_name': 'volume-4b7cf492-2555-458c-9e64-07a7665950d6', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee99ed3-ff55-434e-847d-fa3993aa2c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee99ed3-ff55-434e-847d-fa3993aa2c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16316e9f-c03a-45e9-a8cb-46463b434b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:51 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Volume 4b7cf492-2555-458c-9e64-07a7665950d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7cf492-2555-458c-9e64-07a7665950d6', 'volume_size': 1} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1502699216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7cf492-2555-458c-9e64-07a7665950d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11a33ca500047bfbd2c6a4b14dde9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:04:51Z,use_quota=True,user_id='55cf7d8fc7644f4092b8c04a271acf92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Creating volume 4b7cf492-2555-458c-9e64-07a7665950d6 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:04:51 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:04:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:04:52 devstack sudo[82778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6 1073741824 Apr 24 17:04:52 devstack sudo[82778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:04:53 devstack sudo[82778]: pam_unix(sudo:session): session closed for user root Apr 24 17:04:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6 1073741824" returned: 0 in 1.735s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:04:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:04:53 devstack sudo[83125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6 Apr 24 17:04:53 devstack sudo[83125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:04:54 devstack sudo[83125]: pam_unix(sudo:session): session closed for user root Apr 24 17:04:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6" returned: 0 in 0.646s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:04:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] <== create_volume: return (2450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:04:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.452s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:04:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16316e9f-c03a-45e9-a8cb-46463b434b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7cf492-2555-458c-9e64-07a7665950d6', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bb66c1-c39f-4957-892c-4077802a5163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:54 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Volume volume-4b7cf492-2555-458c-9e64-07a7665950d6 (4b7cf492-2555-458c-9e64-07a7665950d6): created successfully Apr 24 17:04:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bb66c1-c39f-4957-892c-4077802a5163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Flow 'volume_create_manager' (5bf11af5-879e-4849-9bc9-1ec3ad33db80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:04:54 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3c0532e2-46f0-4eee-b848-0f38d3a681c0 tempest-VolumesAdminNegativeTest-1773041227 None] Created volume successfully. Apr 24 17:04:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Acquiring lock "cinder-4b7cf492-2555-458c-9e64-07a7665950d6-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:04:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Lock "cinder-4b7cf492-2555-458c-9e64-07a7665950d6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:04:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Acquiring lock "cinder-quobyte-4b7cf492-2555-458c-9e64-07a7665950d6" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:04:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Lock "cinder-quobyte-4b7cf492-2555-458c-9e64-07a7665950d6" acquired by "delete_volume" :: waited 0.025s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:04:56 devstack cinder-volume[81986]: INFO oslo.privsep.daemon [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpme5qdovh/privsep.sock'] Apr 24 17:04:56 devstack sudo[83173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpme5qdovh/privsep.sock Apr 24 17:04:56 devstack sudo[83173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:04:57 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 24 17:04:57 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 17:04:57 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 17:04:57 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 17:04:57 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 17:04:57 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 17:04:57 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 17:04:57 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 17:04:57 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Flow 'volume_create_manager' (0359d765-102c-424c-b3cf-bee8a335c111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1dbfb9-f253-4733-a402-c67eeebbb64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1dbfb9-f253-4733-a402-c67eeebbb64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:04:58Z,deleted=False,deleted_at=None,display_description='',display_name='c1b0fc19-f187-41e3-8b1d-6a6a13424891-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c7387f-c35d-4953-b2d2-efb8d2f38a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='174118f2b0ab47058f8a761263200b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:04:58Z,use_quota=True,user_id='32eff07718914449aacc7a0b7835decd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddbe4f0-eeeb-452b-a1f2-bc20b01fbf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddbe4f0-eeeb-452b-a1f2-bc20b01fbf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453fba3c-7f0b-4043-8e34-f0d8367f82df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453fba3c-7f0b-4043-8e34-f0d8367f82df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c7387f-c35d-4953-b2d2-efb8d2f38a52', 'volume_name': 'volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f0a7a1-b56e-4e1c-ad2d-bfd711ba74f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f0a7a1-b56e-4e1c-ad2d-bfd711ba74f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805ec382-5649-4384-a498-523dad693357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:58 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Volume e5c7387f-c35d-4953-b2d2-efb8d2f38a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52', 'volume_size': 1} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:04:58Z,deleted=False,deleted_at=None,display_description='',display_name='c1b0fc19-f187-41e3-8b1d-6a6a13424891-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c7387f-c35d-4953-b2d2-efb8d2f38a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='174118f2b0ab47058f8a761263200b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:04:58Z,use_quota=True,user_id='32eff07718914449aacc7a0b7835decd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Creating volume e5c7387f-c35d-4953-b2d2-efb8d2f38a52 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:04:58 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:04:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:04:58 devstack sudo[83183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 1073741824 Apr 24 17:04:58 devstack sudo[83183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:04:59 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 24 17:04:59 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 17:04:59 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 17:04:59 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 17:04:59 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 17:04:59 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 17:04:59 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 17:04:59 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 17:04:59 devstack cinder-volume[81986]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Flow 'volume_create_manager' (3732d4bb-4789-451a-881b-a614d626085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8aeb74-7229-41f1-912b-63199fd012e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8aeb74-7229-41f1-912b-63199fd012e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1906044935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e83e0b1-17e9-4c50-a258-e122a9e697d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d153662139a243038df29dc731d39dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:04:59Z,use_quota=True,user_id='ac58db0d3e434a1192f02724acd208ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea030293-5262-4060-bcd5-07361c7e737a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea030293-5262-4060-bcd5-07361c7e737a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8377d3d3-56ef-4f03-96c4-634383aad860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8377d3d3-56ef-4f03-96c4-634383aad860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e83e0b1-17e9-4c50-a258-e122a9e697d8', 'volume_name': 'volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7fdf57-3dc3-4b00-bc35-aa6405938a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7fdf57-3dc3-4b00-bc35-aa6405938a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778a38a3-0d34-4bf8-865e-995e3485f64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:04:59 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Volume 5e83e0b1-17e9-4c50-a258-e122a9e697d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8', 'volume_size': 1} Apr 24 17:04:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:00 devstack sudo[83183]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 1073741824" returned: 0 in 1.577s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:00 devstack sudo[83218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 Apr 24 17:05:00 devstack sudo[83218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:00 devstack sudo[83173]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:00 devstack cinder-volume[81986]: INFO oslo.privsep.daemon [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Spawned new privsep daemon via rootwrap Apr 24 17:05:00 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Accepted privsep connection to /tmp/tmpme5qdovh/privsep.sock {{(pid=81986) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 24 17:05:00 devstack cinder-volume[81986]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 24 17:05:00 devstack cinder-volume[81986]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 24 17:05:00 devstack cinder-volume[81986]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 24 17:05:00 devstack cinder-volume[81986]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83213 Apr 24 17:05:00 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c40dbf2-fb8e-4747-a061-8d92a0e7c393]: (2,) {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:05:00 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9324752-2f35-4f2b-ba75-51a7bb793a19]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:05:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:00 devstack sudo[83234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6 Apr 24 17:05:00 devstack sudo[83234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:01 devstack sudo[83218]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52" returned: 0 in 1.277s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] <== create_volume: return (2965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.968s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.120s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1906044935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e83e0b1-17e9-4c50-a258-e122a9e697d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d153662139a243038df29dc731d39dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:04:59Z,use_quota=True,user_id='ac58db0d3e434a1192f02724acd208ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Creating volume 5e83e0b1-17e9-4c50-a258-e122a9e697d8 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:05:01 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:01 devstack sudo[83240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8 1073741824 Apr 24 17:05:01 devstack sudo[83240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805ec382-5649-4384-a498-523dad693357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38eec60-20b4-49c1-8b01-e5136d23bbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:01 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Volume volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 (e5c7387f-c35d-4953-b2d2-efb8d2f38a52): created successfully Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38eec60-20b4-49c1-8b01-e5136d23bbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Flow 'volume_create_manager' (0359d765-102c-424c-b3cf-bee8a335c111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:05:01 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-7dcb01d3-5f49-41fe-be2c-51c46226f7ec tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Created volume successfully. Apr 24 17:05:02 devstack sudo[83234]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6" returned: 0 in 1.268s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:02 devstack sudo[83307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6 Apr 24 17:05:02 devstack sudo[83307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:02 devstack sudo[83240]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8 1073741824" returned: 0 in 1.089s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:02 devstack sudo[83315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8 Apr 24 17:05:02 devstack sudo[83315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:02 devstack sudo[83307]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4b7cf492-2555-458c-9e64-07a7665950d6" returned: 0 in 0.769s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Lock "cinder-quobyte-4b7cf492-2555-458c-9e64-07a7665950d6" released by "delete_volume" :: held 6.093s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:05:03 devstack sudo[83317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:05:03 devstack sudo[83317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:03 devstack cinder-volume[81986]: WARNING cinder.quota [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:05:03 devstack cinder-volume[81986]: WARNING cinder.quota [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Created reservations ['258b6db0-71a5-4742-a054-04b15d0b8070', 'afd5b706-89e9-4dce-a8ec-2728b00a2fea', 'b4af6e43-44cc-4f0f-8dfd-0b9088591bde', '1e1dd96e-dbc0-4118-8ae9-1a06ce7a2a0e'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:03 devstack sudo[83319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:05:03 devstack sudo[83319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:03 devstack sudo[83317]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.803s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:05:03 devstack sudo[83315]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8" returned: 0 in 1.038s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778a38a3-0d34-4bf8-865e-995e3485f64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34f6375-2b57-4c89-8adc-c7d2f38eec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:03 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Volume volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8 (5e83e0b1-17e9-4c50-a258-e122a9e697d8): created successfully Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34f6375-2b57-4c89-8adc-c7d2f38eec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Flow 'volume_create_manager' (3732d4bb-4789-451a-881b-a614d626085a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:05:03 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-bd8e4d8d-cd45-44ed-8edd-cd3a2edda879 req-037ba218-f2ef-4864-8fe3-ea219baf2af3 tempest-VolumesGetTestJSON-1841430999 None] Created volume successfully. Apr 24 17:05:04 devstack sudo[83319]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.929s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:05:04 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Deleted volume successfully. Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-feaaa0dd-a7cf-4c61-903b-766f42efe976 tempest-VolumesAdminNegativeTest-1773041227 None] Lock "cinder-4b7cf492-2555-458c-9e64-07a7665950d6-delete_volume" released by "delete_volume" :: held 7.576s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Flow 'volume_create_manager' (0145f35a-f0ff-462f-a06d-229d9449c25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18489bd6-9d19-4114-bb13-808efc84efd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18489bd6-9d19-4114-bb13-808efc84efd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-555991066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5c55fb-77d5-4206-a205-fa188e5026a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a33a326e6224fd4aa7ba1dbeb60e879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:05:04Z,use_quota=True,user_id='6a4c72a0b8fa490790300bd847f899f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3ef009-bcf0-468e-9b4d-f25cd2b5b20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3ef009-bcf0-468e-9b4d-f25cd2b5b20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76cba2c-0df6-4ec7-bc8c-37a6c11de80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76cba2c-0df6-4ec7-bc8c-37a6c11de80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5c55fb-77d5-4206-a205-fa188e5026a0', 'volume_name': 'volume-ae5c55fb-77d5-4206-a205-fa188e5026a0', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5007b71d-d0ea-48d0-81ed-641a037f13c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5007b71d-d0ea-48d0-81ed-641a037f13c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d11fba3-32e7-4ce2-9397-49f2a4946db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:04 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Volume ae5c55fb-77d5-4206-a205-fa188e5026a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5c55fb-77d5-4206-a205-fa188e5026a0', 'volume_size': 1} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-555991066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5c55fb-77d5-4206-a205-fa188e5026a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a33a326e6224fd4aa7ba1dbeb60e879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:05:04Z,use_quota=True,user_id='6a4c72a0b8fa490790300bd847f899f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Creating volume ae5c55fb-77d5-4206-a205-fa188e5026a0 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:05:04 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:05:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:04 devstack sudo[83325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0 1073741824 Apr 24 17:05:04 devstack sudo[83325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Acquiring lock "cinder-5e83e0b1-17e9-4c50-a258-e122a9e697d8-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:05:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Lock "cinder-5e83e0b1-17e9-4c50-a258-e122a9e697d8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:05:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Acquiring lock "cinder-quobyte-5e83e0b1-17e9-4c50-a258-e122a9e697d8" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:05:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Lock "cinder-quobyte-5e83e0b1-17e9-4c50-a258-e122a9e697d8" acquired by "delete_volume" :: waited 0.038s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:05:05 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[77411207-a7dc-401f-af58-340b48b2af64]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:05:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:05 devstack sudo[83325]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0 1073741824" returned: 0 in 1.327s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:06 devstack sudo[83362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0 Apr 24 17:05:06 devstack sudo[83362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:06 devstack sudo[83360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8 Apr 24 17:05:06 devstack sudo[83360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:06 devstack sudo[83360]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8" returned: 0 in 1.032s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:06 devstack sudo[83372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8 Apr 24 17:05:06 devstack sudo[83372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:07 devstack sudo[83362]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0" returned: 0 in 1.014s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:07 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] <== create_volume: return (2450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:05:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.453s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d11fba3-32e7-4ce2-9397-49f2a4946db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5c55fb-77d5-4206-a205-fa188e5026a0', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd79fb66-6a01-4ff2-9407-3a40d2378c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:07 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Volume volume-ae5c55fb-77d5-4206-a205-fa188e5026a0 (ae5c55fb-77d5-4206-a205-fa188e5026a0): created successfully Apr 24 17:05:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd79fb66-6a01-4ff2-9407-3a40d2378c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Flow 'volume_create_manager' (0145f35a-f0ff-462f-a06d-229d9449c25e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:05:07 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ec3b9bf6-6ac8-4026-b11e-c11338775967 tempest-ServerRescueNegativeTestJSON-1305664615 None] Created volume successfully. Apr 24 17:05:07 devstack sudo[83372]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e83e0b1-17e9-4c50-a258-e122a9e697d8" returned: 0 in 0.761s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Lock "cinder-quobyte-5e83e0b1-17e9-4c50-a258-e122a9e697d8" released by "delete_volume" :: held 1.891s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:05:07 devstack cinder-volume[81986]: DEBUG cinder.quota [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Created reservations ['ac2a8fec-710d-4410-a2f9-7d1d35ce3465', '989f163f-3439-4960-b74e-9334b9e3f66e', '1dfd88a1-d45b-4a1b-865b-beaf32e86fde', '1be7720e-1839-4a7b-bbb5-80f074c8a2d9'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:08 devstack sudo[83387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:05:08 devstack sudo[83387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:08 devstack cinder-volume[81986]: WARNING py.warnings [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-08b46c6d-e04c-44f4-aba1-a507edf250dc tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 24 17:05:08 devstack cinder-volume[81986]: .first() Apr 24 17:05:08 devstack cinder-volume[81986]: Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-08b46c6d-e04c-44f4-aba1-a507edf250dc tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-08b46c6d-e04c-44f4-aba1-a507edf250dc tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[996749d6-d77d-4f47-8bf7-aacb5381dbc3]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-08b46c6d-e04c-44f4-aba1-a507edf250dc tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:08 devstack sudo[83390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 Apr 24 17:05:08 devstack sudo[83390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:08 devstack sudo[83387]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.924s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:08 devstack cinder-volume[81986]: DEBUG cinder.manager [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:05:08 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Deleted volume successfully. Apr 24 17:05:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-97c81f01-ab69-487e-ace9-bea1b89f63dc req-3e007bf8-c953-4640-b14e-bf4b39b9d3b0 tempest-VolumesGetTestJSON-1841430999 None] Lock "cinder-5e83e0b1-17e9-4c50-a258-e122a9e697d8-delete_volume" released by "delete_volume" :: held 3.388s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:05:09 devstack sudo[83390]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-08b46c6d-e04c-44f4-aba1-a507edf250dc tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52" returned: 0 in 1.101s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-08b46c6d-e04c-44f4-aba1-a507edf250dc tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.121s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:09 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-08b46c6d-e04c-44f4-aba1-a507edf250dc tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766', 'name': 'volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5685e61-6aef-4104-ac6c-8584c44f064f', 'enforce_multipath': True} {{(pid=81986) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 17:05:09 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-a69b9304-8e9f-4d5d-bc27-99d894dd648a req-08b46c6d-e04c-44f4-aba1-a507edf250dc tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] attachment_update completed successfully. Apr 24 17:05:14 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:05:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Flow 'volume_create_manager' (dc7b80db-667f-46df-a5c0-02acb562c7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:05:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76afcf2c-62c3-492b-80c6-79cf3d12ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76afcf2c-62c3-492b-80c6-79cf3d12ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1654659667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa42e43-70ea-47e1-bc83-ea2291efceb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2389b2fa1a7400d88f2e54d5da300f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:05:15Z,use_quota=True,user_id='48d029bbe1bc4f078746e2d343972ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab72df86-970e-4e9f-821d-0083f9f411bc),volume_type_id=ab72df86-970e-4e9f-821d-0083f9f411bc)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4cd0c92-f16a-4c69-b748-6eebe62aa82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4cd0c92-f16a-4c69-b748-6eebe62aa82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362c4f1b-b46a-4f79-b227-c86020f2b2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362c4f1b-b46a-4f79-b227-c86020f2b2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa42e43-70ea-47e1-bc83-ea2291efceb3', 'volume_name': 'volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa600c5-9f22-43ee-a14a-c9012025c3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa600c5-9f22-43ee-a14a-c9012025c3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c47cf6-f59c-4237-9c8f-607f4968172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:15 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Volume 3aa42e43-70ea-47e1-bc83-ea2291efceb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3', 'volume_size': 1} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1654659667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa42e43-70ea-47e1-bc83-ea2291efceb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2389b2fa1a7400d88f2e54d5da300f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:05:15Z,use_quota=True,user_id='48d029bbe1bc4f078746e2d343972ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab72df86-970e-4e9f-821d-0083f9f411bc),volume_type_id=ab72df86-970e-4e9f-821d-0083f9f411bc)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Creating volume 3aa42e43-70ea-47e1-bc83-ea2291efceb3 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:05:15 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:15 devstack sudo[83533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3 1073741824 Apr 24 17:05:15 devstack sudo[83533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:15 devstack sudo[83533]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3 1073741824" returned: 0 in 0.761s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:15 devstack sudo[83861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3 Apr 24 17:05:15 devstack sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:16 devstack sudo[83861]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3" returned: 0 in 0.618s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:05:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c47cf6-f59c-4237-9c8f-607f4968172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4659ac-fa42-4cbe-9d9d-654f6137fda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:05:16 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Volume volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3 (3aa42e43-70ea-47e1-bc83-ea2291efceb3): created successfully Apr 24 17:05:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4659ac-fa42-4cbe-9d9d-654f6137fda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:05:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Flow 'volume_create_manager' (dc7b80db-667f-46df-a5c0-02acb562c7d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:05:16 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2f2e14bc-078b-44c4-9d3e-3e4504b31242 tempest-VolumeTypesAccessTest-936219503 None] Created volume successfully. Apr 24 17:05:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Acquiring lock "cinder-3aa42e43-70ea-47e1-bc83-ea2291efceb3-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:05:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Lock "cinder-3aa42e43-70ea-47e1-bc83-ea2291efceb3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:05:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Acquiring lock "cinder-quobyte-3aa42e43-70ea-47e1-bc83-ea2291efceb3" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:05:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Lock "cinder-quobyte-3aa42e43-70ea-47e1-bc83-ea2291efceb3" acquired by "delete_volume" :: waited 0.034s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:05:17 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc827527-586a-4d41-9b93-c86ae3741170]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:05:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:17 devstack sudo[83910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3 Apr 24 17:05:17 devstack sudo[83910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:18 devstack sudo[83910]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3" returned: 0 in 0.799s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:18 devstack sudo[83917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3 Apr 24 17:05:18 devstack sudo[83917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:18 devstack sudo[83917]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3aa42e43-70ea-47e1-bc83-ea2291efceb3" returned: 0 in 0.689s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Lock "cinder-quobyte-3aa42e43-70ea-47e1-bc83-ea2291efceb3" released by "delete_volume" :: held 1.574s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:05:19 devstack cinder-volume[81986]: WARNING cinder.quota [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1340441880 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1340441880, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:05:19 devstack cinder-volume[81986]: WARNING cinder.quota [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1340441880 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1340441880, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:05:19 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Created reservations ['eac19e49-5183-4eb7-b824-cd684fe4026a', '2ea6a482-fc42-41b6-8bbb-8a1a3f89d3c3', 'eb0d99fb-8616-4731-994e-a7e81c042609', 'adeb9e32-bf6f-4fea-adc5-69744eb0d231'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:05:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:05:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:05:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:19 devstack sudo[83932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:05:19 devstack sudo[83932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:19 devstack sudo[83932]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.583s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:19 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:05:19 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Deleted volume successfully. Apr 24 17:05:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-301f11a9-e9fd-42f8-b334-295902ef4007 tempest-VolumeTypesAccessTest-936219503 None] Lock "cinder-3aa42e43-70ea-47e1-bc83-ea2291efceb3-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:05:29 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:UPDATE=43,cinder:SELECT=28,cinder:INSERT=9,cinder:DELETE=2 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:05:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Acquiring lock "cinder-ae5c55fb-77d5-4206-a205-fa188e5026a0-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:05:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Lock "cinder-ae5c55fb-77d5-4206-a205-fa188e5026a0-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:05:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Acquiring lock "cinder-quobyte-ae5c55fb-77d5-4206-a205-fa188e5026a0" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:05:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Lock "cinder-quobyte-ae5c55fb-77d5-4206-a205-fa188e5026a0" acquired by "delete_volume" :: waited 0.027s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:05:31 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c863c54f-5594-4531-bb9b-69525f29b4a8]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:05:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:32 devstack sudo[84126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0 Apr 24 17:05:32 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:33 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0" returned: 0 in 1.366s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:33 devstack sudo[84170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0 Apr 24 17:05:33 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:33 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ae5c55fb-77d5-4206-a205-fa188e5026a0" returned: 0 in 0.682s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Lock "cinder-quobyte-ae5c55fb-77d5-4206-a205-fa188e5026a0" released by "delete_volume" :: held 2.109s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:05:34 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Created reservations ['5e6fa8ed-12dc-41b4-a7d0-4adc15b13b9f', '0625f966-b20d-4c03-a47c-993a73cc2450', '843b805d-c73b-4d28-829d-0a1b2a76d197', '2225ea0d-7b47-441f-973d-0dd64982f054'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:05:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:05:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:05:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:05:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:05:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:05:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:05:34 devstack sudo[84173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:05:34 devstack sudo[84173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:05:34 devstack sudo[84173]: pam_unix(sudo:session): session closed for user root Apr 24 17:05:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.727s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:05:34 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:05:34 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Deleted volume successfully. Apr 24 17:05:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6a0d464-5e1b-4691-875e-6742e042cf74 tempest-ServerRescueNegativeTestJSON-1305664615 None] Lock "cinder-ae5c55fb-77d5-4206-a205-fa188e5026a0-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:05:44 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=35,cinder:UPDATE=46,cinder:INSERT=10,cinder:DELETE=6 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:05:44 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:06:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:06:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:06:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:06:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:06:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:06:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:06:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:02 devstack sudo[84472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:06:02 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:03 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.565s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Flow 'volume_create_manager' (c25c1f0a-9b99-4f64-bb53-7221c06d6f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92c100a-c10c-4274-8e2f-f485909c3ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92c100a-c10c-4274-8e2f-f485909c3ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-671285779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c4ba37-8471-43dc-b7ad-6796387e6436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73d998c487b4f94b5a807079468b5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:06:30Z,use_quota=True,user_id='4352c899b88a424a81f0ee0f7abd30a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f6355f-1356-458b-93fc-53d9689a16d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f6355f-1356-458b-93fc-53d9689a16d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d5d28b-0668-47b9-ab3b-b7eec405b9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d5d28b-0668-47b9-ab3b-b7eec405b9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c4ba37-8471-43dc-b7ad-6796387e6436', 'volume_name': 'volume-23c4ba37-8471-43dc-b7ad-6796387e6436', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2699e9f-e802-4d3e-962b-02ee7011c1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2699e9f-e802-4d3e-962b-02ee7011c1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e612e9b-b7fa-49ed-bb36-910aaf94229a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:30 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Volume 23c4ba37-8471-43dc-b7ad-6796387e6436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c4ba37-8471-43dc-b7ad-6796387e6436', 'volume_size': 1} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-671285779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c4ba37-8471-43dc-b7ad-6796387e6436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73d998c487b4f94b5a807079468b5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:06:30Z,use_quota=True,user_id='4352c899b88a424a81f0ee0f7abd30a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Creating volume 23c4ba37-8471-43dc-b7ad-6796387e6436 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:06:30 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:06:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:30 devstack sudo[84690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436 1073741824 Apr 24 17:06:30 devstack sudo[84690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:31 devstack sudo[84690]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436 1073741824" returned: 0 in 1.185s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:31 devstack sudo[84699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436 Apr 24 17:06:31 devstack sudo[84699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:32 devstack sudo[84699]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436" returned: 0 in 0.650s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:06:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:06:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e612e9b-b7fa-49ed-bb36-910aaf94229a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c4ba37-8471-43dc-b7ad-6796387e6436', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4def874-d39b-4178-953d-a9b686b7ff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:32 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Volume volume-23c4ba37-8471-43dc-b7ad-6796387e6436 (23c4ba37-8471-43dc-b7ad-6796387e6436): created successfully Apr 24 17:06:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4def874-d39b-4178-953d-a9b686b7ff23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Flow 'volume_create_manager' (c25c1f0a-9b99-4f64-bb53-7221c06d6f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:06:32 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-de251929-4d11-469a-aaa3-302cf125394d tempest-DeleteServersTestJSON-1172456313 None] Created volume successfully. Apr 24 17:06:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-3ab67a4f-f072-4763-955e-9c33a8c0d6c1 req-810d846f-392d-48fb-86cd-020b50ef8a13 tempest-DeleteServersTestJSON-1172456313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:06:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-3ab67a4f-f072-4763-955e-9c33a8c0d6c1 req-810d846f-392d-48fb-86cd-020b50ef8a13 tempest-DeleteServersTestJSON-1172456313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:06:38 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe63f1c-c484-44a9-91fa-4963cfa0c8cc]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:06:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-3ab67a4f-f072-4763-955e-9c33a8c0d6c1 req-810d846f-392d-48fb-86cd-020b50ef8a13 tempest-DeleteServersTestJSON-1172456313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:38 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436 Apr 24 17:06:38 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:40 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-3ab67a4f-f072-4763-955e-9c33a8c0d6c1 req-810d846f-392d-48fb-86cd-020b50ef8a13 tempest-DeleteServersTestJSON-1172456313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436" returned: 0 in 1.401s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-3ab67a4f-f072-4763-955e-9c33a8c0d6c1 req-810d846f-392d-48fb-86cd-020b50ef8a13 tempest-DeleteServersTestJSON-1172456313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.480s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:06:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-3ab67a4f-f072-4763-955e-9c33a8c0d6c1 req-810d846f-392d-48fb-86cd-020b50ef8a13 tempest-DeleteServersTestJSON-1172456313 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766', 'name': 'volume-23c4ba37-8471-43dc-b7ad-6796387e6436', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e631670-bdcd-42df-a640-b3884aa1b33c', 'enforce_multipath': True} {{(pid=81986) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 17:06:40 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-3ab67a4f-f072-4763-955e-9c33a8c0d6c1 req-810d846f-392d-48fb-86cd-020b50ef8a13 tempest-DeleteServersTestJSON-1172456313 None] attachment_update completed successfully. Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Flow 'volume_create_manager' (f1b25fba-b002-4ddf-9bcd-51b91674bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3078e9be-f2ea-4f6d-b8da-c0cccf228a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3078e9be-f2ea-4f6d-b8da-c0cccf228a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:06:44Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c92467-f4ac-4e1a-b62a-2a565338c708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='174118f2b0ab47058f8a761263200b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:06:44Z,use_quota=True,user_id='32eff07718914449aacc7a0b7835decd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b38d62-d9fe-43ec-98a8-b04375708860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b38d62-d9fe-43ec-98a8-b04375708860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2abc707-98f6-436e-a474-d38cb6ed3ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.image.glance [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Creating Keystone auth plugin from conf {{(pid=81986) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2abc707-98f6-436e-a474-d38cb6ed3ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15c92467-f4ac-4e1a-b62a-2a565338c708', 'volume_name': 'volume-15c92467-f4ac-4e1a-b62a-2a565338c708', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6cce44-18d8-4a2c-b491-7845ee1fd295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6cce44-18d8-4a2c-b491-7845ee1fd295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0347a726-d239-448f-a8e5-70b360f11209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:44 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Volume 15c92467-f4ac-4e1a-b62a-2a565338c708: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15c92467-f4ac-4e1a-b62a-2a565338c708', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 17:06:44 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Trying to clone 15c92467-f4ac-4e1a-b62a-2a565338c708 from image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]). {{(pid=81986) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 17:06:45 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 17:06:45 devstack cinder-volume[81986]: INFO cinder.image.image_utils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Image download 20.69 MB at 20.69 MB/s Apr 24 17:06:45 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc529018-832f-4da1-b86c-c408582f6f45]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:06:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:45 devstack sudo[84886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD Apr 24 17:06:45 devstack sudo[84886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:46 devstack sudo[84886]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD" returned: 0 in 0.919s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:46 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Temporary image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 is fetched for user 32eff07718914449aacc7a0b7835decd. {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 17:06:46 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d3d03f-d127-4eef-979d-fc60ba5fdfb3]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:06:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:46 devstack sudo[84895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD Apr 24 17:06:46 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:47 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD" returned: 0 in 1.242s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:06:44Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c92467-f4ac-4e1a-b62a-2a565338c708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='174118f2b0ab47058f8a761263200b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:06:44Z,use_quota=True,user_id='32eff07718914449aacc7a0b7835decd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Creating volume 15c92467-f4ac-4e1a-b62a-2a565338c708 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:06:47 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:06:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:47 devstack sudo[84914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 1073741824 Apr 24 17:06:47 devstack sudo[84914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:49 devstack sudo[84914]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 1073741824" returned: 0 in 2.395s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:49 devstack sudo[85002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 Apr 24 17:06:49 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:51 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708" returned: 0 in 1.451s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] <== create_volume: return (3916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:06:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.920s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:06:51 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Attempting download of 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}])) to volume 15c92467-f4ac-4e1a-b62a-2a565338c708. {{(pid=81986) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 17:06:51 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ace837d-cdce-468d-862e-8b5cde6f9b66]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:06:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_00_w1_xg {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:51 devstack sudo[85038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_00_w1_xg Apr 24 17:06:51 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:52 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_00_w1_xg" returned: 0 in 0.650s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_00_w1_xg {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:52 devstack sudo[85043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_00_w1_xg Apr 24 17:06:52 devstack sudo[85043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:52 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-61daed4b-d3cc-47d9-8da8-a167b993aa48 req-b39ec055-40dd-4a99-b0c9-fc59bfda95ff tempest-DeleteServersTestJSON-1172456313 None] Terminate volume connection completed successfully. Apr 24 17:06:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-61daed4b-d3cc-47d9-8da8-a167b993aa48 req-b39ec055-40dd-4a99-b0c9-fc59bfda95ff tempest-DeleteServersTestJSON-1172456313 None] Deleting attachment 2e631670-bdcd-42df-a640-b3884aa1b33c. {{(pid=81986) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 17:06:52 devstack sudo[85043]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_00_w1_xg" returned: 1 in 0.769s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_00_w1_xg' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:06:52 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2acd51f-03e4-4a97-b6ac-aeb38b8ab22f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:06:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:52 devstack sudo[85048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD Apr 24 17:06:52 devstack sudo[85048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (c374fd35-dd49-4711-8313-5d2dff1a3f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e339a6f-6ba4-44c6-aa04-71160521cc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e339a6f-6ba4-44c6-aa04-71160521cc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1618437470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d52eb43-4660-4b0d-b917-d0e775cf0ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:06:53Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314b4b32-9997-428a-8eef-a0544647fe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314b4b32-9997-428a-8eef-a0544647fe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69afdd13-998f-4f61-bb25-48cef7feb9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69afdd13-998f-4f61-bb25-48cef7feb9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d52eb43-4660-4b0d-b917-d0e775cf0ebb', 'volume_name': 'volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7647619-c97e-4da4-83ad-f888b9fe8573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7647619-c97e-4da4-83ad-f888b9fe8573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbf7792-08f3-46ae-b775-9f708e405e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:53 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Volume 4d52eb43-4660-4b0d-b917-d0e775cf0ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb', 'volume_size': 1} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1618437470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d52eb43-4660-4b0d-b917-d0e775cf0ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:06:53Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Creating volume 4d52eb43-4660-4b0d-b917-d0e775cf0ebb {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:06:53 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:53 devstack sudo[85050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb 1073741824 Apr 24 17:06:53 devstack sudo[85050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:53 devstack sudo[85048]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD" returned: 0 in 0.861s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 was qcow2, converting to raw {{(pid=81986) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 17:06:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:53 devstack sudo[85059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 Apr 24 17:06:53 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:54 devstack sudo[85050]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb 1073741824" returned: 0 in 1.160s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:54 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb Apr 24 17:06:54 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:55 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb" returned: 0 in 0.606s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:06:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:06:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbf7792-08f3-46ae-b775-9f708e405e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d432fe8-7fc5-437b-960c-906f8e7f2930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:55 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Volume volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb (4d52eb43-4660-4b0d-b917-d0e775cf0ebb): created successfully Apr 24 17:06:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d432fe8-7fc5-437b-960c-906f8e7f2930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (c374fd35-dd49-4711-8313-5d2dff1a3f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:06:55 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f495ff47-585d-45c5-abda-fcffcb5279d9 tempest-VolumesActionsTest-1334588460 None] Created volume successfully. Apr 24 17:06:55 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708" returned: 0 in 1.854s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:55 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_oy67apw_devstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:06:55 devstack cinder-volume[81986]: INFO cinder.image.image_utils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Converted 112.00 MB image at 60.37 MB/s Apr 24 17:06:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:55 devstack sudo[85083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 1G Apr 24 17:06:55 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:56 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 1G" returned: 0 in 0.583s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:56 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7883c4dd-409e-4bef-884a-89a832377106]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:06:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:56 devstack sudo[85131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 Apr 24 17:06:56 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7b1fb2-606f-4e59-8876-7220102a975c tempest-VolumesActionsTest-1334588460 None] Acquiring lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb" by "attach_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:06:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7b1fb2-606f-4e59-8876-7220102a975c tempest-VolumesActionsTest-1334588460 None] Lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb" acquired by "attach_volume" :: waited 0.041s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:06:57 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5e7b1fb2-606f-4e59-8876-7220102a975c tempest-VolumesActionsTest-1334588460 None] Attaching volume 4d52eb43-4660-4b0d-b917-d0e775cf0ebb to instance 48f0eae7-c52b-42b8-9de3-ab3e295df839 at mountpoint /dev/vdb on host None. Apr 24 17:06:57 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5e7b1fb2-606f-4e59-8876-7220102a975c tempest-VolumesActionsTest-1334588460 None] Attach volume completed successfully. Apr 24 17:06:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7b1fb2-606f-4e59-8876-7220102a975c tempest-VolumesActionsTest-1334588460 None] Lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb" released by "attach_volume" :: held 0.320s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:06:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Acquiring lock "cinder-23c4ba37-8471-43dc-b7ad-6796387e6436-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:06:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Lock "cinder-23c4ba37-8471-43dc-b7ad-6796387e6436-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:06:57 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Acquiring lock "cinder-quobyte-23c4ba37-8471-43dc-b7ad-6796387e6436" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:06:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708" returned: 0 in 1.579s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Lock "cinder-quobyte-23c4ba37-8471-43dc-b7ad-6796387e6436" acquired by "delete_volume" :: waited 0.042s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:06:57 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[626d1db1-e893-4fe8-af87-dc13e1aecce0]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:06:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:57 devstack sudo[85161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 Apr 24 17:06:57 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:58 devstack sudo[85162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436 Apr 24 17:06:58 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:58 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3e580cb5-ac91-4032-a106-9246ca8a1fd5 tempest-VolumesActionsTest-1824854590 None] Terminate volume connection completed successfully. Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e580cb5-ac91-4032-a106-9246ca8a1fd5 tempest-VolumesActionsTest-1824854590 None] Acquiring lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb-detach_volume" by "detach_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e580cb5-ac91-4032-a106-9246ca8a1fd5 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:06:59 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3e580cb5-ac91-4032-a106-9246ca8a1fd5 tempest-VolumesActionsTest-1824854590 None] Detaching volume 4d52eb43-4660-4b0d-b917-d0e775cf0ebb from instance 48f0eae7-c52b-42b8-9de3-ab3e295df839. Apr 24 17:06:59 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3e580cb5-ac91-4032-a106-9246ca8a1fd5 tempest-VolumesActionsTest-1824854590 None] Detach volume completed successfully. Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e580cb5-ac91-4032-a106-9246ca8a1fd5 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:06:59 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708" returned: 1 in 1.482s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Downloaded image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}])) to volume 15c92467-f4ac-4e1a-b62a-2a565338c708 successfully. {{(pid=81986) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Temporary image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 for user 32eff07718914449aacc7a0b7835decd is deleted. {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Marking volume 15c92467-f4ac-4e1a-b62a-2a565338c708 as bootable. {{(pid=81986) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Copying metadata from image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 to 15c92467-f4ac-4e1a-b62a-2a565338c708. {{(pid=81986) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Creating volume glance metadata for volume 15c92467-f4ac-4e1a-b62a-2a565338c708 backed by image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81986) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0347a726-d239-448f-a8e5-70b360f11209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c92467-f4ac-4e1a-b62a-2a565338c708', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69311d08-8b45-4e6e-93e9-6e7f0a9981aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:06:59 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Volume volume-15c92467-f4ac-4e1a-b62a-2a565338c708 (15c92467-f4ac-4e1a-b62a-2a565338c708): created successfully Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69311d08-8b45-4e6e-93e9-6e7f0a9981aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Flow 'volume_create_manager' (f1b25fba-b002-4ddf-9bcd-51b91674bda1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:06:59 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-b2edb984-ec27-45fc-a51d-47f335814db6 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Created volume successfully. Apr 24 17:06:59 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436" returned: 0 in 1.598s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:06:59 devstack sudo[85174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436 Apr 24 17:06:59 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:06:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fb67e945-b33c-4679-b591-9c06630d0c58 tempest-VolumesActionsTest-1334588460 None] Acquiring lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb-detach_volume" by "detach_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fb67e945-b33c-4679-b591-9c06630d0c58 tempest-VolumesActionsTest-1334588460 None] Lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb-detach_volume" acquired by "detach_volume" :: waited 0.063s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:00 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-fb67e945-b33c-4679-b591-9c06630d0c58 tempest-VolumesActionsTest-1334588460 None] Volume detach called, but volume not attached. Apr 24 17:07:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fb67e945-b33c-4679-b591-9c06630d0c58 tempest-VolumesActionsTest-1334588460 None] Lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:00 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-23c4ba37-8471-43dc-b7ad-6796387e6436" returned: 0 in 1.103s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Lock "cinder-quobyte-23c4ba37-8471-43dc-b7ad-6796387e6436" released by "delete_volume" :: held 2.814s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-d5c62ace-ce4e-4239-9d1e-edf4f7b49c6e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-d5c62ace-ce4e-4239-9d1e-edf4f7b49c6e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:00 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Created reservations ['ed10ec31-a7a8-4deb-8f91-b14f02ae3c13', '9ed5be5e-5f37-42cf-9822-d0cde77cfffd', '696aa6e1-d706-4a02-8c6c-72e099dba5a1', '383e5efd-94c6-4eef-a701-9c3ac3296a54'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff956ef0-1ac2-49d9-9f7a-655d3dec345f]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-d5c62ace-ce4e-4239-9d1e-edf4f7b49c6e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Acquiring lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Acquiring lock "cinder-quobyte-4d52eb43-4660-4b0d-b917-d0e775cf0ebb" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Lock "cinder-quobyte-4d52eb43-4660-4b0d-b917-d0e775cf0ebb" acquired by "delete_volume" :: waited 0.038s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a63f32-63ef-4c59-9d31-242780567b31]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:01 devstack sudo[85191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:01 devstack sudo[85191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:01 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 Apr 24 17:07:01 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:01 devstack sudo[85192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb Apr 24 17:07:01 devstack sudo[85192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:02 devstack sudo[85192]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb" returned: 0 in 1.032s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:02 devstack sudo[85208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb Apr 24 17:07:02 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:02 devstack sudo[85191]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 1.608s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:02 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Deleted volume successfully. Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5bcb83a3-e5a8-4c6a-b846-857b3e4a6595 tempest-DeleteServersTestJSON-1172456313 None] Lock "cinder-23c4ba37-8471-43dc-b7ad-6796387e6436-delete_volume" released by "delete_volume" :: held 5.239s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:02 devstack sudo[85234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:02 devstack sudo[85234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:03 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-d5c62ace-ce4e-4239-9d1e-edf4f7b49c6e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708" returned: 0 in 2.169s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-d5c62ace-ce4e-4239-9d1e-edf4f7b49c6e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:03 devstack sudo[85236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 Apr 24 17:07:03 devstack sudo[85236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:03 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4d52eb43-4660-4b0d-b917-d0e775cf0ebb" returned: 0 in 1.429s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Lock "cinder-quobyte-4d52eb43-4660-4b0d-b917-d0e775cf0ebb" released by "delete_volume" :: held 2.538s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:03 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Created reservations ['d5448a20-9d39-4b1e-9112-e210b178ee6f', '5fd7a642-9ec5-4a82-9f76-6fc7395b3c02', 'ef38c113-c3ba-42ae-8d4d-cea3b4a68edb', '50692720-12c7-4e29-b988-cabef66acccd'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:03 devstack sudo[85254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:03 devstack sudo[85254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:04 devstack sudo[85234]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 1.454s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:04 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:04 devstack sudo[85236]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-d5c62ace-ce4e-4239-9d1e-edf4f7b49c6e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708" returned: 1 in 1.306s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-d5c62ace-ce4e-4239-9d1e-edf4f7b49c6e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:07:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-d5c62ace-ce4e-4239-9d1e-edf4f7b49c6e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.626s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-d5c62ace-ce4e-4239-9d1e-edf4f7b49c6e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766', 'name': 'volume-15c92467-f4ac-4e1a-b62a-2a565338c708', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48ec1fe3-9545-4620-8ebe-2ddc0f8b12c0', 'enforce_multipath': True} {{(pid=81986) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 17:07:04 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-de901d64-4c6c-40ae-bf0f-40108e28ad9f req-d5c62ace-ce4e-4239-9d1e-edf4f7b49c6e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] attachment_update completed successfully. Apr 24 17:07:04 devstack sudo[85254]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.749s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:04 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:04 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Deleted volume successfully. Apr 24 17:07:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-645fb890-32f2-43e3-b648-f112e603857c tempest-VolumesActionsTest-1334588460 None] Lock "cinder-4d52eb43-4660-4b0d-b917-d0e775cf0ebb-delete_volume" released by "delete_volume" :: held 3.630s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Flow 'volume_create_manager' (dabf2c37-118e-4cf4-9f3a-908cc2f2360a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4e1e60-8e91-4a8c-bafe-52813010a094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4e1e60-8e91-4a8c-bafe-52813010a094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-422689923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b570e00-6d7e-4aba-964f-f67851bfbc5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bf1dbe7d7f40c688c46d3cd4fd3593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:10Z,use_quota=True,user_id='a440b2bb11734b4fa73b02c941be624d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ada7ce7-1a8f-41fe-8ef0-218124d521a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ada7ce7-1a8f-41fe-8ef0-218124d521a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ac2183-b6cf-474d-8edf-1f1e0f87ea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ac2183-b6cf-474d-8edf-1f1e0f87ea1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b570e00-6d7e-4aba-964f-f67851bfbc5e', 'volume_name': 'volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964c09dd-ee82-4744-971a-0b3c986ec38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964c09dd-ee82-4744-971a-0b3c986ec38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2ce9e2-a91c-4f76-924b-3df23a074934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:10 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Volume 2b570e00-6d7e-4aba-964f-f67851bfbc5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e', 'volume_size': 1} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-422689923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b570e00-6d7e-4aba-964f-f67851bfbc5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bf1dbe7d7f40c688c46d3cd4fd3593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:10Z,use_quota=True,user_id='a440b2bb11734b4fa73b02c941be624d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Creating volume 2b570e00-6d7e-4aba-964f-f67851bfbc5e {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:10 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:10 devstack sudo[85331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e 1073741824 Apr 24 17:07:10 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:11 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e 1073741824" returned: 0 in 0.969s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:11 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e Apr 24 17:07:11 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:11 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-7fef040b-959e-449b-a299-4b3b99b8221e tempest-GroupsV320Test-2138066276 None] Group tempest-GroupsV320Test-Group-1406770869: creating Apr 24 17:07:11 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-7fef040b-959e-449b-a299-4b3b99b8221e tempest-GroupsV320Test-2138066276 None] Group tempest-GroupsV320Test-Group-1406770869: created successfully Apr 24 17:07:11 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-7fef040b-959e-449b-a299-4b3b99b8221e tempest-GroupsV320Test-2138066276 None] Create group completed successfully. Apr 24 17:07:12 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e" returned: 0 in 0.689s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:12 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2ce9e2-a91c-4f76-924b-3df23a074934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de59f39b-3cbb-4a26-bfc7-1f6c9c4b19cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:12 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Volume volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e (2b570e00-6d7e-4aba-964f-f67851bfbc5e): created successfully Apr 24 17:07:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de59f39b-3cbb-4a26-bfc7-1f6c9c4b19cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Flow 'volume_create_manager' (dabf2c37-118e-4cf4-9f3a-908cc2f2360a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:12 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ef6bd12e-a3e2-4ea3-a1e9-506e12322d77 tempest-ServersNegativeTestJSON-1997476641 None] Created volume successfully. Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (448a249e-2270-4915-b863-f5cba981bb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5f2047-3543-4266-ad41-ac2da4455e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5f2047-3543-4266-ad41-ac2da4455e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-436493849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:13Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e3fd3e-53a2-4870-89b0-79ae5cb586c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e3fd3e-53a2-4870-89b0-79ae5cb586c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5d775e-ba57-4673-8db3-ac9d31e3fbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5d775e-ba57-4673-8db3-ac9d31e3fbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c', 'volume_name': 'volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54144342-be2c-4704-a1ab-244af7d9573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54144342-be2c-4704-a1ab-244af7d9573a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5a988e-8953-47fd-b05e-b9bccfe25c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:13 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Volume c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c', 'volume_size': 1} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-436493849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:13Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Creating volume c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:13 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:13 devstack sudo[85371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c 1073741824 Apr 24 17:07:13 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-3b144ebe-e8a4-4ab4-8e75-35076cb8f57a tempest-GroupsV320Test-2138066276 None] Created reservations ['9a610633-345b-46d8-b77e-25b114b71d69'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3b144ebe-e8a4-4ab4-8e75-35076cb8f57a tempest-GroupsV320Test-2138066276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3b144ebe-e8a4-4ab4-8e75-35076cb8f57a tempest-GroupsV320Test-2138066276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3b144ebe-e8a4-4ab4-8e75-35076cb8f57a tempest-GroupsV320Test-2138066276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3b144ebe-e8a4-4ab4-8e75-35076cb8f57a tempest-GroupsV320Test-2138066276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3b144ebe-e8a4-4ab4-8e75-35076cb8f57a tempest-GroupsV320Test-2138066276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3b144ebe-e8a4-4ab4-8e75-35076cb8f57a tempest-GroupsV320Test-2138066276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:14 devstack sudo[85373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:14 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:14 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c 1073741824" returned: 0 in 1.426s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:14 devstack sudo[85378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c Apr 24 17:07:14 devstack sudo[85378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Flow 'volume_create_manager' (1972741f-bae1-4e62-a9f6-be5f7c8cffaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc64361-140b-47bc-b338-fb808ad3d5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc64361-140b-47bc-b338-fb808ad3d5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1526729207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b949b19-b88f-40de-a0fb-2d3a936ae50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bf1dbe7d7f40c688c46d3cd4fd3593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:15Z,use_quota=True,user_id='a440b2bb11734b4fa73b02c941be624d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae96c455-8cdd-4c2c-bd8d-85660bb7ac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae96c455-8cdd-4c2c-bd8d-85660bb7ac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bf3e4f-1b1b-4c15-a774-73da43bab737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bf3e4f-1b1b-4c15-a774-73da43bab737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b949b19-b88f-40de-a0fb-2d3a936ae50f', 'volume_name': 'volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd52d7fe-c43b-4cc9-bd81-7e19398ce231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd52d7fe-c43b-4cc9-bd81-7e19398ce231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853f37fc-73e7-4f31-b17b-f6d2dca60dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:14 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Volume 6b949b19-b88f-40de-a0fb-2d3a936ae50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f', 'volume_size': 1} Apr 24 17:07:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:15 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3b144ebe-e8a4-4ab4-8e75-35076cb8f57a tempest-GroupsV320Test-2138066276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.996s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-3b144ebe-e8a4-4ab4-8e75-35076cb8f57a tempest-GroupsV320Test-2138066276 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:15 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3b144ebe-e8a4-4ab4-8e75-35076cb8f57a tempest-GroupsV320Test-2138066276 None] Delete group completed successfully. Apr 24 17:07:15 devstack sudo[85378]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c" returned: 0 in 0.884s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] <== create_volume: return (2413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1526729207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b949b19-b88f-40de-a0fb-2d3a936ae50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bf1dbe7d7f40c688c46d3cd4fd3593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:15Z,use_quota=True,user_id='a440b2bb11734b4fa73b02c941be624d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Creating volume 6b949b19-b88f-40de-a0fb-2d3a936ae50f {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:15 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:15 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f 1073741824 Apr 24 17:07:15 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5a988e-8953-47fd-b05e-b9bccfe25c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a5cebb-5aaf-4d9c-976d-c046d2ae1ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:15 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Volume volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c (c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c): created successfully Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a5cebb-5aaf-4d9c-976d-c046d2ae1ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (448a249e-2270-4915-b863-f5cba981bb92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:15 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5acd6a1a-798c-4a70-951d-d6d4809f2dd0 tempest-VolumesActionsTest-1334588460 None] Created volume successfully. Apr 24 17:07:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Acquiring lock "cinder-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Lock "cinder-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Acquiring lock "cinder-quobyte-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Lock "cinder-quobyte-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c" acquired by "delete_volume" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:16 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5940b41e-960c-4fce-9ca1-0dae1b0df8f6]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:16 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f 1073741824" returned: 0 in 1.258s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:17 devstack sudo[85389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f Apr 24 17:07:17 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:17 devstack sudo[85388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c Apr 24 17:07:17 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:17 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f" returned: 0 in 0.713s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853f37fc-73e7-4f31-b17b-f6d2dca60dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eeecd41-7f22-4fc7-9457-888b917e7668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:17 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Volume volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f (6b949b19-b88f-40de-a0fb-2d3a936ae50f): created successfully Apr 24 17:07:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eeecd41-7f22-4fc7-9457-888b917e7668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Flow 'volume_create_manager' (1972741f-bae1-4e62-a9f6-be5f7c8cffaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:17 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c" returned: 0 in 0.838s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:17 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-6fdaed37-9e6f-4ff4-ae4b-ff35191c23ee tempest-ServersNegativeTestJSON-1997476641 None] Created volume successfully. Apr 24 17:07:17 devstack sudo[85396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c Apr 24 17:07:17 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:18 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c" returned: 0 in 0.886s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Lock "cinder-quobyte-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c" released by "delete_volume" :: held 1.773s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Acquiring lock "cinder-6b949b19-b88f-40de-a0fb-2d3a936ae50f-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Lock "cinder-6b949b19-b88f-40de-a0fb-2d3a936ae50f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Created reservations ['85f9311d-05b7-4635-9cbc-31ec55868c7b', '5c1d0997-6ac3-4c2e-8647-dfa74e775527', 'e6f03aca-1184-467b-90aa-dff01dc0b8a7', '48e8e2b8-2870-4e3c-8965-e6908bb99860'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Acquiring lock "cinder-quobyte-6b949b19-b88f-40de-a0fb-2d3a936ae50f" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Lock "cinder-quobyte-6b949b19-b88f-40de-a0fb-2d3a936ae50f" acquired by "delete_volume" :: waited 0.039s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[65be6c9c-ed8e-4600-88b5-08a51f6e246c]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:19 devstack sudo[85401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:19 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:19 devstack sudo[85400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f Apr 24 17:07:19 devstack sudo[85400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:19 devstack sudo[85400]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f" returned: 0 in 0.937s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:19 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.902s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:19 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:19 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Deleted volume successfully. Apr 24 17:07:19 devstack sudo[85414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f Apr 24 17:07:19 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-efa5c070-d8cf-4513-beb5-5d843b36feab tempest-VolumesActionsTest-1824854590 None] Lock "cinder-c2e4cfeb-e6bd-4b5c-b690-007ab0fac06c-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (79774116-58a0-474e-94b7-e112280f4048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebd5ab7-0d68-41e2-bb3d-27d8f5b8db67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebd5ab7-0d68-41e2-bb3d-27d8f5b8db67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-638525156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da88a366-8b00-4c64-965c-a97419074dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:20Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8ab975-1193-467d-89c2-baf72170f767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8ab975-1193-467d-89c2-baf72170f767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21011353-a03c-4b86-83c9-816edddc6252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21011353-a03c-4b86-83c9-816edddc6252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da88a366-8b00-4c64-965c-a97419074dd1', 'volume_name': 'volume-da88a366-8b00-4c64-965c-a97419074dd1', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2842f7c9-8f73-4060-a694-134c62653b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2842f7c9-8f73-4060-a694-134c62653b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9dd298-6589-4d1d-a484-b99a38068df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:20 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Volume da88a366-8b00-4c64-965c-a97419074dd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da88a366-8b00-4c64-965c-a97419074dd1', 'volume_size': 1} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-638525156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da88a366-8b00-4c64-965c-a97419074dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:20Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Creating volume da88a366-8b00-4c64-965c-a97419074dd1 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:20 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:20 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1 1073741824 Apr 24 17:07:20 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:20 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6b949b19-b88f-40de-a0fb-2d3a936ae50f" returned: 0 in 0.865s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Lock "cinder-quobyte-6b949b19-b88f-40de-a0fb-2d3a936ae50f" released by "delete_volume" :: held 1.866s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Created reservations ['ff533625-fbe8-423b-9858-35c9c682e1f5', '41a1ac76-0019-4f14-8983-e39ce7bf530d', 'c444a7b4-7f92-4ec8-afe5-31ded7bacdef', '64a0272c-6bd7-4efa-ad06-fcc0380fd479'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:20 devstack sudo[85444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:20 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Acquiring lock "cinder-2b570e00-6d7e-4aba-964f-f67851bfbc5e-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Lock "cinder-2b570e00-6d7e-4aba-964f-f67851bfbc5e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Acquiring lock "cinder-quobyte-2b570e00-6d7e-4aba-964f-f67851bfbc5e" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Lock "cinder-quobyte-2b570e00-6d7e-4aba-964f-f67851bfbc5e" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:21 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f83848c-ed79-44fc-9c52-e77dcebb5b0c]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:21 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:21 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e Apr 24 17:07:21 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1 1073741824" returned: 0 in 1.002s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:21 devstack sudo[85450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1 Apr 24 17:07:21 devstack sudo[85450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:21 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.592s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:21 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:21 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Deleted volume successfully. Apr 24 17:07:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c5f1177-fc83-44c8-9c89-000d1cf781a3 tempest-ServersNegativeTestJSON-1997476641 None] Lock "cinder-6b949b19-b88f-40de-a0fb-2d3a936ae50f-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:22 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e" returned: 0 in 0.863s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:22 devstack sudo[85450]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1" returned: 0 in 0.772s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:22 devstack sudo[85457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e Apr 24 17:07:22 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9dd298-6589-4d1d-a484-b99a38068df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da88a366-8b00-4c64-965c-a97419074dd1', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6da5e49-c8ec-4df0-aab4-84698639ac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:22 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Volume volume-da88a366-8b00-4c64-965c-a97419074dd1 (da88a366-8b00-4c64-965c-a97419074dd1): created successfully Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6da5e49-c8ec-4df0-aab4-84698639ac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (79774116-58a0-474e-94b7-e112280f4048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:22 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-89074e67-980b-4606-afef-4c593e6ca84c tempest-VolumesActionsTest-1334588460 None] Created volume successfully. Apr 24 17:07:22 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2b570e00-6d7e-4aba-964f-f67851bfbc5e" returned: 0 in 0.580s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Lock "cinder-quobyte-2b570e00-6d7e-4aba-964f-f67851bfbc5e" released by "delete_volume" :: held 1.483s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Created reservations ['be547e7a-a064-40e3-b84f-0b1d2db66d2e', '11be3a24-60bd-4a4e-b3f2-1021c0529283', '09393123-f973-4697-bad8-a7c04f9daee4', '3072caf2-afd7-4851-afd5-1e79b30059de'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:22 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:22 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Acquiring lock "cinder-da88a366-8b00-4c64-965c-a97419074dd1-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-da88a366-8b00-4c64-965c-a97419074dd1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:23 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.637s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:23 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:23 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Deleted volume successfully. Apr 24 17:07:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-51a7327a-4860-4776-be27-0bf2d9395ba6 tempest-ServersNegativeTestJSON-1997476641 None] Lock "cinder-2b570e00-6d7e-4aba-964f-f67851bfbc5e-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Acquiring lock "cinder-quobyte-da88a366-8b00-4c64-965c-a97419074dd1" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-quobyte-da88a366-8b00-4c64-965c-a97419074dd1" acquired by "delete_volume" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:23 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cbf74f-ddb5-46cf-8099-c780090717e8]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:23 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1 Apr 24 17:07:23 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:24 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1" returned: 0 in 0.608s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:24 devstack sudo[85486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1 Apr 24 17:07:24 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:24 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-da88a366-8b00-4c64-965c-a97419074dd1" returned: 0 in 0.534s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-quobyte-da88a366-8b00-4c64-965c-a97419074dd1" released by "delete_volume" :: held 1.242s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=78,cinder:UPDATE=82,cinder:DELETE=6,cinder:INSERT=19 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Created reservations ['1e4072a7-944b-4989-8f02-d4424b551aae', 'c0656451-7af6-46ac-a134-c97de9c3a957', '9ff5a01b-32aa-466e-8416-75586f12a51d', '2a559ac7-3578-4f98-a651-ad1135a9c9f8'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:24 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:24 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:25 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.784s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:25 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:25 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Deleted volume successfully. Apr 24 17:07:25 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:UPDATE=72,cinder:INSERT=26,cinder:SELECT=78,cinder:DELETE=7 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:07:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0a4db89c-00cb-4fc3-aecd-f63b1eaa9c73 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-da88a366-8b00-4c64-965c-a97419074dd1-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (b87d93cf-e71e-49cc-b72c-a4430073527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21b9c27-5883-41b3-a0a0-929f0975af2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21b9c27-5883-41b3-a0a0-929f0975af2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1797851394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb84b2e-71b1-4823-a35b-c86a264f2788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:26Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417409cc-d79e-42fd-8991-c21783d3222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417409cc-d79e-42fd-8991-c21783d3222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbc294d-c2ef-43e5-9faf-455fb1f16912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbc294d-c2ef-43e5-9faf-455fb1f16912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb84b2e-71b1-4823-a35b-c86a264f2788', 'volume_name': 'volume-efb84b2e-71b1-4823-a35b-c86a264f2788', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3705386-6d19-4d27-b1ee-01fa2f0948c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3705386-6d19-4d27-b1ee-01fa2f0948c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b748bfb-53b1-482e-99b5-311af113f8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:26 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Volume efb84b2e-71b1-4823-a35b-c86a264f2788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb84b2e-71b1-4823-a35b-c86a264f2788', 'volume_size': 1} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1797851394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb84b2e-71b1-4823-a35b-c86a264f2788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:26Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Creating volume efb84b2e-71b1-4823-a35b-c86a264f2788 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:26 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:26 devstack sudo[85536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788 1073741824 Apr 24 17:07:26 devstack sudo[85536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:27 devstack sudo[85536]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788 1073741824" returned: 0 in 0.831s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:27 devstack sudo[85544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788 Apr 24 17:07:27 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:27 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788" returned: 0 in 0.532s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b748bfb-53b1-482e-99b5-311af113f8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb84b2e-71b1-4823-a35b-c86a264f2788', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426bd5c9-a1a6-445a-9baa-15659c50b0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:27 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Volume volume-efb84b2e-71b1-4823-a35b-c86a264f2788 (efb84b2e-71b1-4823-a35b-c86a264f2788): created successfully Apr 24 17:07:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426bd5c9-a1a6-445a-9baa-15659c50b0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (b87d93cf-e71e-49cc-b72c-a4430073527d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:27 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-8ec91bb3-56df-43ac-b071-e7dedb1dd0e5 tempest-VolumesActionsTest-1334588460 None] Created volume successfully. Apr 24 17:07:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Acquiring lock "cinder-efb84b2e-71b1-4823-a35b-c86a264f2788-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-efb84b2e-71b1-4823-a35b-c86a264f2788-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Acquiring lock "cinder-quobyte-efb84b2e-71b1-4823-a35b-c86a264f2788" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-quobyte-efb84b2e-71b1-4823-a35b-c86a264f2788" acquired by "delete_volume" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fd6bf6-91ad-4590-99ed-95a4b8864a5b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:28 devstack sudo[85575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788 Apr 24 17:07:28 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:29 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788" returned: 0 in 0.941s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:29 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788 Apr 24 17:07:29 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:30 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-efb84b2e-71b1-4823-a35b-c86a264f2788" returned: 0 in 0.769s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-quobyte-efb84b2e-71b1-4823-a35b-c86a264f2788" released by "delete_volume" :: held 1.811s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:30 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Created reservations ['a0aa389c-a72e-4156-b7ca-1e007873a4f5', 'e42d62c0-ed02-4cbe-a313-7092878ebaf1', '54e67792-ef4d-4fb7-8248-d15c8bc2b614', '8e90942a-fe7a-488b-99ee-58146906793b'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:30 devstack sudo[85601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:30 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:31 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.745s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:31 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Deleted volume successfully. Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-58a96ab8-6667-4676-a054-9bf46d26e697 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-efb84b2e-71b1-4823-a35b-c86a264f2788-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (df66190c-9430-4de0-b4ce-64f7e91aaffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e190450-c57c-4cf5-b0b0-5b654d8fd115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e190450-c57c-4cf5-b0b0-5b654d8fd115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1809522539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c252eda5-6949-4d50-bb72-bdfd8d7b830d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:32Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80877de1-79fe-46f2-94c9-07b800e26c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80877de1-79fe-46f2-94c9-07b800e26c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7317db-b06d-4311-8108-41f900881cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7317db-b06d-4311-8108-41f900881cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c252eda5-6949-4d50-bb72-bdfd8d7b830d', 'volume_name': 'volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261a1576-a2b7-48da-a9b9-bc472f3ef257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261a1576-a2b7-48da-a9b9-bc472f3ef257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7caeccf-5d05-4566-8e00-adb9c5b3ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:31 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Volume c252eda5-6949-4d50-bb72-bdfd8d7b830d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d', 'volume_size': 1} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1809522539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c252eda5-6949-4d50-bb72-bdfd8d7b830d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:32Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Creating volume c252eda5-6949-4d50-bb72-bdfd8d7b830d {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:31 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:31 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d 1073741824 Apr 24 17:07:31 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:33 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d 1073741824" returned: 0 in 1.202s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:33 devstack sudo[85643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d Apr 24 17:07:33 devstack sudo[85643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:33 devstack sudo[85643]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d" returned: 0 in 0.643s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7caeccf-5d05-4566-8e00-adb9c5b3ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8645ee-797e-41a2-9605-7718b7faecfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:33 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Volume volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d (c252eda5-6949-4d50-bb72-bdfd8d7b830d): created successfully Apr 24 17:07:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8645ee-797e-41a2-9605-7718b7faecfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (df66190c-9430-4de0-b4ce-64f7e91aaffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:33 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-67a4c62c-315a-402b-a577-7368a28978fe tempest-VolumesActionsTest-1334588460 None] Created volume successfully. Apr 24 17:07:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Acquiring lock "cinder-c252eda5-6949-4d50-bb72-bdfd8d7b830d-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-c252eda5-6949-4d50-bb72-bdfd8d7b830d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Acquiring lock "cinder-quobyte-c252eda5-6949-4d50-bb72-bdfd8d7b830d" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-quobyte-c252eda5-6949-4d50-bb72-bdfd8d7b830d" acquired by "delete_volume" :: waited 0.063s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:34 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a235227a-dfe7-48b8-af25-add737fd7658]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:34 devstack sudo[85648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d Apr 24 17:07:34 devstack sudo[85648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:35 devstack sudo[85648]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d" returned: 0 in 0.903s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:35 devstack sudo[85659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d Apr 24 17:07:35 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:36 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c252eda5-6949-4d50-bb72-bdfd8d7b830d" returned: 0 in 0.656s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-quobyte-c252eda5-6949-4d50-bb72-bdfd8d7b830d" released by "delete_volume" :: held 1.740s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:36 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Created reservations ['b372a6ea-dcb6-4074-88ba-6b4047e0099a', '8698d81a-6513-4341-bcf1-f436ff3640e8', '3f322d04-b87a-46f5-8f36-027016f4de19', 'fd744bf3-c961-473e-909d-6b54787eba0d'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:36 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:36 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:36 devstack sudo[85669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:36 devstack sudo[85669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:37 devstack sudo[85669]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.895s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:37 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Deleted volume successfully. Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ff2c4bd1-6957-494c-9d7b-04e01a006453 tempest-VolumesActionsTest-1824854590 None] Lock "cinder-c252eda5-6949-4d50-bb72-bdfd8d7b830d-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (f7ded2b2-9937-4031-9f10-78f2ce43a4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c2c15f-d501-4861-968a-b16801d516b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c2c15f-d501-4861-968a-b16801d516b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1710305748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660a0c17-6a31-4aa6-9a03-6363753999ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:37Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ee8ef9-0bd5-4811-8a85-69fcdd6eee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ee8ef9-0bd5-4811-8a85-69fcdd6eee3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d6b671-3a07-41d7-8c6c-ad43efda858c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d6b671-3a07-41d7-8c6c-ad43efda858c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660a0c17-6a31-4aa6-9a03-6363753999ec', 'volume_name': 'volume-660a0c17-6a31-4aa6-9a03-6363753999ec', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d8ca14-ca84-4fd3-8ec1-362d5aea4030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d8ca14-ca84-4fd3-8ec1-362d5aea4030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa5dae7-edd0-48d5-8e8b-ea1843ae39d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:37 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Volume 660a0c17-6a31-4aa6-9a03-6363753999ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660a0c17-6a31-4aa6-9a03-6363753999ec', 'volume_size': 1} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1710305748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660a0c17-6a31-4aa6-9a03-6363753999ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd02f79d350c4e25ac05ecfdc033b417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:37Z,use_quota=True,user_id='db9c3f054b0a437dadb16724d1c9d125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Creating volume 660a0c17-6a31-4aa6-9a03-6363753999ec {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:37 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:37 devstack sudo[85695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec 1073741824 Apr 24 17:07:37 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:38 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec 1073741824" returned: 0 in 1.074s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:38 devstack sudo[85712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec Apr 24 17:07:38 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:39 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec" returned: 0 in 0.636s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa5dae7-edd0-48d5-8e8b-ea1843ae39d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660a0c17-6a31-4aa6-9a03-6363753999ec', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f01b882-c862-407b-8a23-25d1cefa9a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:39 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Volume volume-660a0c17-6a31-4aa6-9a03-6363753999ec (660a0c17-6a31-4aa6-9a03-6363753999ec): created successfully Apr 24 17:07:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f01b882-c862-407b-8a23-25d1cefa9a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Flow 'volume_create_manager' (f7ded2b2-9937-4031-9f10-78f2ce43a4ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:39 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-31dfbd83-f0d4-4553-aa51-68cc6736147a tempest-VolumesActionsTest-1334588460 None] Created volume successfully. Apr 24 17:07:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Acquiring lock "cinder-660a0c17-6a31-4aa6-9a03-6363753999ec-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Lock "cinder-660a0c17-6a31-4aa6-9a03-6363753999ec-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Acquiring lock "cinder-quobyte-660a0c17-6a31-4aa6-9a03-6363753999ec" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Lock "cinder-quobyte-660a0c17-6a31-4aa6-9a03-6363753999ec" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:41 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d81ac3-4808-45b3-8db8-33b02e6f4d5b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:41 devstack sudo[85748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec Apr 24 17:07:41 devstack sudo[85748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:42 devstack sudo[85748]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec" returned: 0 in 1.076s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:42 devstack sudo[85753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec Apr 24 17:07:42 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:43 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-660a0c17-6a31-4aa6-9a03-6363753999ec" returned: 0 in 0.866s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Lock "cinder-quobyte-660a0c17-6a31-4aa6-9a03-6363753999ec" released by "delete_volume" :: held 2.031s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:43 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Created reservations ['72aa265d-749f-4660-813b-0d4124692317', '37b8b236-4411-473b-83fb-8019a5e7f904', '2fee4e5f-27df-4ea8-92b7-d98f9b858164', '0faad4d3-7452-4dee-a8d8-2fd69f1b6563'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:43 devstack sudo[85757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:43 devstack sudo[85757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:44 devstack sudo[85757]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.954s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Flow 'volume_create_manager' (cc798b00-bd94-4bf5-ad0f-1b171531a90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784d6429-4e21-4db0-8d4e-6b12deaaf282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:44 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Deleted volume successfully. Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784d6429-4e21-4db0-8d4e-6b12deaaf282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1937532840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13173bcc-40bb-4608-8ea2-49c43c124ad9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77bf978bac64135ba11f3fd3bcd4825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:44Z,use_quota=True,user_id='f4a044cb76ac41bba6b96b14f3657699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c12134-9096-44fb-87cf-e08b8486b6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c12134-9096-44fb-87cf-e08b8486b6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09393d67-49c9-428b-a613-875514e16e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09393d67-49c9-428b-a613-875514e16e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13173bcc-40bb-4608-8ea2-49c43c124ad9', 'volume_name': 'volume-13173bcc-40bb-4608-8ea2-49c43c124ad9', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f167c22a-15e3-4f58-8f6d-dcff1c88f063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f167c22a-15e3-4f58-8f6d-dcff1c88f063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e366051-8326-424c-9883-ef3a16af3e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:44 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Volume 13173bcc-40bb-4608-8ea2-49c43c124ad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13173bcc-40bb-4608-8ea2-49c43c124ad9', 'volume_size': 1} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1937532840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13173bcc-40bb-4608-8ea2-49c43c124ad9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77bf978bac64135ba11f3fd3bcd4825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:44Z,use_quota=True,user_id='f4a044cb76ac41bba6b96b14f3657699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Creating volume 13173bcc-40bb-4608-8ea2-49c43c124ad9 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:44 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-52c8c777-5214-453c-a505-62e9c917792c tempest-VolumesActionsTest-1334588460 None] Lock "cinder-660a0c17-6a31-4aa6-9a03-6363753999ec-delete_volume" released by "delete_volume" :: held 3.543s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:44 devstack sudo[85787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9 1073741824 Apr 24 17:07:44 devstack sudo[85787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:45 devstack sudo[85787]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9 1073741824" returned: 0 in 0.899s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:45 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9 Apr 24 17:07:45 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:46 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9" returned: 0 in 0.640s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e366051-8326-424c-9883-ef3a16af3e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13173bcc-40bb-4608-8ea2-49c43c124ad9', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843f2977-a01b-4da0-870f-db2ca9ee3c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:46 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Volume volume-13173bcc-40bb-4608-8ea2-49c43c124ad9 (13173bcc-40bb-4608-8ea2-49c43c124ad9): created successfully Apr 24 17:07:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843f2977-a01b-4da0-870f-db2ca9ee3c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Flow 'volume_create_manager' (cc798b00-bd94-4bf5-ad0f-1b171531a90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:46 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-bd9b15b6-3489-435f-8768-350f6966e04c tempest-VolumesTestJSON-1922289305 None] Created volume successfully. Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Flow 'volume_create_manager' (a55b5d80-5732-43c5-ac06-7cb18cf10377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f980401-8e20-4777-bcef-20471d0ed069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f980401-8e20-4777-bcef-20471d0ed069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1833375259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3775de5a-bace-4f73-9112-4747465b370a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77bf978bac64135ba11f3fd3bcd4825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:47Z,use_quota=True,user_id='f4a044cb76ac41bba6b96b14f3657699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03dd4ac-72de-4a4a-95a1-6863693a6aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03dd4ac-72de-4a4a-95a1-6863693a6aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9060f965-d42f-4cf1-bfa3-a201820d6f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9060f965-d42f-4cf1-bfa3-a201820d6f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3775de5a-bace-4f73-9112-4747465b370a', 'volume_name': 'volume-3775de5a-bace-4f73-9112-4747465b370a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda263a7-c8d7-4dfb-807d-ed6fe46decca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda263a7-c8d7-4dfb-807d-ed6fe46decca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68e7d7f-0af0-417b-9119-46f888c7b6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:47 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Volume 3775de5a-bace-4f73-9112-4747465b370a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3775de5a-bace-4f73-9112-4747465b370a', 'volume_size': 1} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1833375259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3775de5a-bace-4f73-9112-4747465b370a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77bf978bac64135ba11f3fd3bcd4825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:47Z,use_quota=True,user_id='f4a044cb76ac41bba6b96b14f3657699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Creating volume 3775de5a-bace-4f73-9112-4747465b370a {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:47 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:47 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a 1073741824 Apr 24 17:07:47 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:47 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-368b85e2-ac9c-40c5-8fed-1bd37c5a89ef tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Terminate volume connection completed successfully. Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-368b85e2-ac9c-40c5-8fed-1bd37c5a89ef tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Deleting attachment 48ec1fe3-9545-4620-8ebe-2ddc0f8b12c0. {{(pid=81986) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "cinder-15c92467-f4ac-4e1a-b62a-2a565338c708-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:47 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "cinder-15c92467-f4ac-4e1a-b62a-2a565338c708-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "cinder-quobyte-15c92467-f4ac-4e1a-b62a-2a565338c708" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:48 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a 1073741824" returned: 0 in 0.913s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "cinder-quobyte-15c92467-f4ac-4e1a-b62a-2a565338c708" acquired by "delete_volume" :: waited 0.036s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8293173-78ae-410e-bf3b-86e7f8ef4a97]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:48 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a Apr 24 17:07:48 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:48 devstack sudo[85806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 Apr 24 17:07:48 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:48 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a" returned: 0 in 0.661s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68e7d7f-0af0-417b-9119-46f888c7b6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3775de5a-bace-4f73-9112-4747465b370a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7413ca2e-2a70-4138-9882-2234aa40d85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:48 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Volume volume-3775de5a-bace-4f73-9112-4747465b370a (3775de5a-bace-4f73-9112-4747465b370a): created successfully Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7413ca2e-2a70-4138-9882-2234aa40d85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Flow 'volume_create_manager' (a55b5d80-5732-43c5-ac06-7cb18cf10377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:48 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-8a4d0d6a-aeb5-4bb8-bde4-335217ec2f02 tempest-VolumesTestJSON-1922289305 None] Created volume successfully. Apr 24 17:07:48 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708" returned: 0 in 0.831s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:49 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 Apr 24 17:07:49 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:49 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708" returned: 1 in 0.774s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:49 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708 Apr 24 17:07:49 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Flow 'volume_create_manager' (f9a2534e-8a05-4bdb-b15c-d817cfe840ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129d52dc-91a9-4a85-a0ff-bb3ff75b0477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129d52dc-91a9-4a85-a0ff-bb3ff75b0477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-260708706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8b6009-52e8-41c0-bc6c-0c222f62bac1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77bf978bac64135ba11f3fd3bcd4825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:50Z,use_quota=True,user_id='f4a044cb76ac41bba6b96b14f3657699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8fc93b-5843-46f7-af98-5d2c3e65ded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8fc93b-5843-46f7-af98-5d2c3e65ded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c3580e-1c9e-47fe-9462-438b63a0c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c3580e-1c9e-47fe-9462-438b63a0c68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f8b6009-52e8-41c0-bc6c-0c222f62bac1', 'volume_name': 'volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81f76ce-06b7-4810-b5bc-c22776f6c9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81f76ce-06b7-4810-b5bc-c22776f6c9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7c0a76-8b40-4758-b614-a492ee8068f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:49 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Volume 2f8b6009-52e8-41c0-bc6c-0c222f62bac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1', 'volume_size': 1} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-260708706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8b6009-52e8-41c0-bc6c-0c222f62bac1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c77bf978bac64135ba11f3fd3bcd4825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:50Z,use_quota=True,user_id='f4a044cb76ac41bba6b96b14f3657699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Creating volume 2f8b6009-52e8-41c0-bc6c-0c222f62bac1 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:49 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:49 devstack sudo[85821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1 1073741824 Apr 24 17:07:49 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:50 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c92467-f4ac-4e1a-b62a-2a565338c708" returned: 0 in 0.580s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:50 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "cinder-quobyte-15c92467-f4ac-4e1a-b62a-2a565338c708" released by "delete_volume" :: held 2.276s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:50 devstack cinder-volume[81986]: DEBUG cinder.quota [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Created reservations ['f1ba353d-39a8-4845-9a36-23af9ae007d2', '4d12f7f9-c4e1-4c21-b316-4f08db286468', '8a1afa5d-bada-47bb-b4f0-44cfc7951851', 'd937564e-f8f9-486f-88b0-e5ae7ffbfd59'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:50 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:50 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:50 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1 1073741824" returned: 0 in 0.943s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:50 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1 Apr 24 17:07:50 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:51 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.516s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:51 devstack cinder-volume[81986]: DEBUG cinder.manager [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:51 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Deleted volume successfully. Apr 24 17:07:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-a59339a2-3bf2-43fa-ba1a-b0a0e2c5c86a req-262b127b-2ea0-4344-aea4-2cb6ec7ad5b3 tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "cinder-15c92467-f4ac-4e1a-b62a-2a565338c708-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:51 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1" returned: 0 in 0.534s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7c0a76-8b40-4758-b614-a492ee8068f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97174d1-b8a3-403e-a11b-764f139fb1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:51 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Volume volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1 (2f8b6009-52e8-41c0-bc6c-0c222f62bac1): created successfully Apr 24 17:07:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97174d1-b8a3-403e-a11b-764f139fb1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Flow 'volume_create_manager' (f9a2534e-8a05-4bdb-b15c-d817cfe840ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:51 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-62cb7a52-0664-4f48-9d13-47bd602c1a08 tempest-VolumesTestJSON-1922289305 None] Created volume successfully. Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Flow 'volume_create_manager' (c9f2648b-72a5-4369-a657-6d8c1456b77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8806fec3-6eec-477c-b985-a06206c16ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8806fec3-6eec-477c-b985-a06206c16ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1437548238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971eb416-eafb-434d-8351-339019a28ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c199778381f04d9ca6f464383aaddac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:53Z,use_quota=True,user_id='b93e1f014d4f4f729e0f94e627d270e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5683d7fc-ebde-44f1-97b9-b0e1f50833d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5683d7fc-ebde-44f1-97b9-b0e1f50833d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083cfb00-5e80-4fca-97a7-553816992db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083cfb00-5e80-4fca-97a7-553816992db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '971eb416-eafb-434d-8351-339019a28ce3', 'volume_name': 'volume-971eb416-eafb-434d-8351-339019a28ce3', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba48d17-358b-4a16-aa26-1f9a357b6a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba48d17-358b-4a16-aa26-1f9a357b6a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e15e1e-a891-4e4d-8790-94a4200247a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:52 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Volume 971eb416-eafb-434d-8351-339019a28ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-971eb416-eafb-434d-8351-339019a28ce3', 'volume_size': 1} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1437548238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971eb416-eafb-434d-8351-339019a28ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c199778381f04d9ca6f464383aaddac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:53Z,use_quota=True,user_id='b93e1f014d4f4f729e0f94e627d270e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Creating volume 971eb416-eafb-434d-8351-339019a28ce3 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:52 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:52 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3 1073741824 Apr 24 17:07:52 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:53 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Acquiring lock "cinder-2f8b6009-52e8-41c0-bc6c-0c222f62bac1-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:53 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Lock "cinder-2f8b6009-52e8-41c0-bc6c-0c222f62bac1-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:53 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Acquiring lock "cinder-quobyte-2f8b6009-52e8-41c0-bc6c-0c222f62bac1" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:53 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Lock "cinder-quobyte-2f8b6009-52e8-41c0-bc6c-0c222f62bac1" acquired by "delete_volume" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:53 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d2c32e-43d4-454d-b990-4b2d131301a7]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:53 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1 Apr 24 17:07:53 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:53 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3 1073741824" returned: 0 in 0.926s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:53 devstack sudo[85870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3 Apr 24 17:07:53 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:54 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1" returned: 0 in 1.005s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:54 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1 Apr 24 17:07:54 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:54 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3" returned: 0 in 0.774s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e15e1e-a891-4e4d-8790-94a4200247a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-971eb416-eafb-434d-8351-339019a28ce3', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c3142b-befc-46a9-9f98-632b307c66d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:54 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Volume volume-971eb416-eafb-434d-8351-339019a28ce3 (971eb416-eafb-434d-8351-339019a28ce3): created successfully Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c3142b-befc-46a9-9f98-632b307c66d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Flow 'volume_create_manager' (c9f2648b-72a5-4369-a657-6d8c1456b77e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:54 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-1dc17ea3-0e47-4b1d-a540-919a3bba4ca5 tempest-VolumesListAdminTestJSON-377934820 None] Created volume successfully. Apr 24 17:07:54 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2f8b6009-52e8-41c0-bc6c-0c222f62bac1" returned: 0 in 0.499s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Lock "cinder-quobyte-2f8b6009-52e8-41c0-bc6c-0c222f62bac1" released by "delete_volume" :: held 1.599s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Created reservations ['ef3c9008-7ccd-40f0-8ba0-8be608ab927d', '263ab8ea-6911-40ca-b2a4-e700c08fbcb5', '776e5135-d9ab-4799-af36-12ed57b851f4', 'c5bf8f89-d83a-4ffb-834e-439c06628044'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:55 devstack sudo[85881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:55 devstack sudo[85881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Flow 'volume_create_manager' (0e87fc65-35b2-4f05-99b3-d60d9559df28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fda5d69-90e7-4dc3-917d-891b959b1063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fda5d69-90e7-4dc3-917d-891b959b1063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2103445898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c10ed80-59b7-4904-8e52-bbe963158df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c199778381f04d9ca6f464383aaddac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:55Z,use_quota=True,user_id='b93e1f014d4f4f729e0f94e627d270e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c316a1-faf4-4018-85eb-35d2a67bc153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c316a1-faf4-4018-85eb-35d2a67bc153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54989984-dd9f-4375-bb42-663e3afe6705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54989984-dd9f-4375-bb42-663e3afe6705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c10ed80-59b7-4904-8e52-bbe963158df5', 'volume_name': 'volume-9c10ed80-59b7-4904-8e52-bbe963158df5', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca3a891-8e45-4468-a694-fcc8921cb42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca3a891-8e45-4468-a694-fcc8921cb42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afdaa95f-aa15-4abd-9de5-fa4f41420045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:55 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Volume 9c10ed80-59b7-4904-8e52-bbe963158df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c10ed80-59b7-4904-8e52-bbe963158df5', 'volume_size': 1} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2103445898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c10ed80-59b7-4904-8e52-bbe963158df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c199778381f04d9ca6f464383aaddac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:55Z,use_quota=True,user_id='b93e1f014d4f4f729e0f94e627d270e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Creating volume 9c10ed80-59b7-4904-8e52-bbe963158df5 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:55 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Acquiring lock "cinder-3775de5a-bace-4f73-9112-4747465b370a-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:55 devstack sudo[85884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5 1073741824 Apr 24 17:07:55 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Lock "cinder-3775de5a-bace-4f73-9112-4747465b370a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Acquiring lock "cinder-quobyte-3775de5a-bace-4f73-9112-4747465b370a" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Lock "cinder-quobyte-3775de5a-bace-4f73-9112-4747465b370a" acquired by "delete_volume" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[6035818a-8b85-4ef3-86a3-a55fa8e482cf]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:55 devstack sudo[85886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a Apr 24 17:07:55 devstack sudo[85886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:55 devstack sudo[85881]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.870s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:55 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Deleted volume successfully. Apr 24 17:07:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fa0f0369-d9f0-45de-b98f-d75a69dcd1e3 tempest-VolumesTestJSON-1922289305 None] Lock "cinder-2f8b6009-52e8-41c0-bc6c-0c222f62bac1-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:56 devstack sudo[85886]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a" returned: 0 in 0.655s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:56 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5 1073741824" returned: 0 in 0.843s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:56 devstack sudo[85895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a Apr 24 17:07:56 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:56 devstack sudo[85897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5 Apr 24 17:07:56 devstack sudo[85897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:57 devstack sudo[85897]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5" returned: 0 in 0.654s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afdaa95f-aa15-4abd-9de5-fa4f41420045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c10ed80-59b7-4904-8e52-bbe963158df5', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cdcca17-3b4f-40b6-ba7f-7c94ebafff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:57 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3775de5a-bace-4f73-9112-4747465b370a" returned: 0 in 0.779s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:57 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Volume volume-9c10ed80-59b7-4904-8e52-bbe963158df5 (9c10ed80-59b7-4904-8e52-bbe963158df5): created successfully Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cdcca17-3b4f-40b6-ba7f-7c94ebafff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Flow 'volume_create_manager' (0e87fc65-35b2-4f05-99b3-d60d9559df28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Lock "cinder-quobyte-3775de5a-bace-4f73-9112-4747465b370a" released by "delete_volume" :: held 1.509s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:57 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-35afb2ae-ca50-4ff2-8220-e7b40460a112 tempest-VolumesListAdminTestJSON-377934820 None] Created volume successfully. Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Created reservations ['d97a5211-fc75-4888-bfd7-6d98f725d619', '4832ece9-01d4-497b-b123-7ab1e3abe9ed', '1a3b734b-de0d-43bb-8428-0a394ae8c4b0', '8a0a1c4f-45a0-4331-ac70-c9fee3fd10e7'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:57 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:57 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:57 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.578s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:07:57 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Deleted volume successfully. Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Acquiring lock "cinder-13173bcc-40bb-4608-8ea2-49c43c124ad9-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93ebfed8-4391-439f-8e6b-71f9a02ec5fb tempest-VolumesTestJSON-1922289305 None] Lock "cinder-3775de5a-bace-4f73-9112-4747465b370a-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Lock "cinder-13173bcc-40bb-4608-8ea2-49c43c124ad9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Acquiring lock "cinder-quobyte-13173bcc-40bb-4608-8ea2-49c43c124ad9" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Lock "cinder-quobyte-13173bcc-40bb-4608-8ea2-49c43c124ad9" acquired by "delete_volume" :: waited 0.034s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f49e82-b322-4399-bd85-30bc8f9e2576]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Flow 'volume_create_manager' (8de5cec5-015d-4007-b64d-c24355ee558f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6bcfe4-d62d-47ed-9035-97b14ab1aaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6bcfe4-d62d-47ed-9035-97b14ab1aaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1721579180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bdf6ad-acb9-46af-8fa5-0ced5140316b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c199778381f04d9ca6f464383aaddac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:58Z,use_quota=True,user_id='b93e1f014d4f4f729e0f94e627d270e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:58 devstack sudo[85938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9 Apr 24 17:07:58 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddcd695-67f1-452f-9c04-4a43d9c954cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddcd695-67f1-452f-9c04-4a43d9c954cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed935ff7-6e0e-46b6-848c-9ed7ce286f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed935ff7-6e0e-46b6-848c-9ed7ce286f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8bdf6ad-acb9-46af-8fa5-0ced5140316b', 'volume_name': 'volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e4ee25-bd24-47d8-ad76-ecd3b90d2387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e4ee25-bd24-47d8-ad76-ecd3b90d2387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc85e9b-4ac7-4ca1-a324-4fd3248ab31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:58 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Volume a8bdf6ad-acb9-46af-8fa5-0ced5140316b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b', 'volume_size': 1} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1721579180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bdf6ad-acb9-46af-8fa5-0ced5140316b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c199778381f04d9ca6f464383aaddac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:07:58Z,use_quota=True,user_id='b93e1f014d4f4f729e0f94e627d270e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Creating volume a8bdf6ad-acb9-46af-8fa5-0ced5140316b {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:07:58 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:58 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b 1073741824 Apr 24 17:07:58 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:58 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9" returned: 0 in 0.640s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:58 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9 Apr 24 17:07:58 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:59 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b 1073741824" returned: 0 in 0.739s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:59 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b Apr 24 17:07:59 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:59 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-13173bcc-40bb-4608-8ea2-49c43c124ad9" returned: 0 in 0.524s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Lock "cinder-quobyte-13173bcc-40bb-4608-8ea2-49c43c124ad9" released by "delete_volume" :: held 1.246s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Created reservations ['4f3c44f6-eed0-4b30-8396-4fa057f69dab', 'b52aad7b-9549-443c-b5dd-b33e31d759e1', 'df424c18-3e62-45e6-8939-cd34c815a20a', '700f1308-066c-4016-9421-6b720bb2cbc9'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:07:59 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:07:59 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:07:59 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b" returned: 0 in 0.563s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc85e9b-4ac7-4ca1-a324-4fd3248ab31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8bb21c-2b8d-49a3-b20a-7725794af6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:07:59 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Volume volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b (a8bdf6ad-acb9-46af-8fa5-0ced5140316b): created successfully Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8bb21c-2b8d-49a3-b20a-7725794af6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:07:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Flow 'volume_create_manager' (8de5cec5-015d-4007-b64d-c24355ee558f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:07:59 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b202251c-6df2-4255-8a7d-144fceea4331 tempest-VolumesListAdminTestJSON-377934820 None] Created volume successfully. Apr 24 17:07:59 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.569s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:00 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:00 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Deleted volume successfully. Apr 24 17:08:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-90389315-5593-422c-88f0-d50d8fb7415d tempest-VolumesTestJSON-1922289305 None] Lock "cinder-13173bcc-40bb-4608-8ea2-49c43c124ad9-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Flow 'volume_create_manager' (b5f89cbb-b1ff-4527-bb42-021cb73bbf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cbf254-56e3-4d00-8b2c-caa6bef1f126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cbf254-56e3-4d00-8b2c-caa6bef1f126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='495c8b6a880c441e874bc777de29b027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:01Z,use_quota=True,user_id='134253c420ce41adafaa1bca5301e747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfc3dc7-1d34-4ac1-90e9-3930166f0f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfc3dc7-1d34-4ac1-90e9-3930166f0f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1451a6-ab58-4e88-b5f1-8c2f5d30a2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1451a6-ab58-4e88-b5f1-8c2f5d30a2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf', 'volume_name': 'volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e61f3f2-5494-4a88-8e95-cf98f9f99aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e61f3f2-5494-4a88-8e95-cf98f9f99aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7da150c-1970-471b-afca-45edf70003a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:01 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Volume 9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf', 'volume_size': 1} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='495c8b6a880c441e874bc777de29b027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:01Z,use_quota=True,user_id='134253c420ce41adafaa1bca5301e747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Creating volume 9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:01 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:08:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:01 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf 1073741824 Apr 24 17:08:01 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:02 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf 1073741824" returned: 0 in 0.943s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:02 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf Apr 24 17:08:02 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:08:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:02 devstack sudo[85992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:02 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:03 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf" returned: 0 in 0.923s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7da150c-1970-471b-afca-45edf70003a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c6ffd6-7c13-4d26-88bf-74739cafaebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:03 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Volume volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf (9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf): created successfully Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c6ffd6-7c13-4d26-88bf-74739cafaebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Flow 'volume_create_manager' (b5f89cbb-b1ff-4527-bb42-021cb73bbf86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:03 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0acf3a6b-7151-4ebc-a8dc-25a1f5f72e2b tempest-VolumesListAdminTestJSON-1448538723 None] Created volume successfully. Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:08:03 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Flow 'volume_create_manager' (d2c626f8-4f12-4516-8e74-6dd87f450b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6088bafe-315c-4582-a330-af2e8232dedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.708s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6088bafe-315c-4582-a330-af2e8232dedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1825816156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add98a85-420e-43c2-bafd-cb4b39aa5a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea0ac1d411d4f2b8c10e1f558eb5061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:04Z,use_quota=True,user_id='a3490d4bc2a049cebbee715f35c6ae2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03df7d2c-8489-4fc6-9feb-64005c49a298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03df7d2c-8489-4fc6-9feb-64005c49a298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fa1d1c-fdec-4171-97d5-008cd552fcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fa1d1c-fdec-4171-97d5-008cd552fcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add98a85-420e-43c2-bafd-cb4b39aa5a23', 'volume_name': 'volume-add98a85-420e-43c2-bafd-cb4b39aa5a23', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51700b29-d52a-49b1-aba8-f460f453e19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51700b29-d52a-49b1-aba8-f460f453e19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597d7e08-a962-4867-b015-b7c817f32d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:03 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Volume add98a85-420e-43c2-bafd-cb4b39aa5a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add98a85-420e-43c2-bafd-cb4b39aa5a23', 'volume_size': 1} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1825816156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add98a85-420e-43c2-bafd-cb4b39aa5a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea0ac1d411d4f2b8c10e1f558eb5061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:04Z,use_quota=True,user_id='a3490d4bc2a049cebbee715f35c6ae2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Creating volume add98a85-420e-43c2-bafd-cb4b39aa5a23 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:03 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:03 devstack sudo[85996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 1073741824 Apr 24 17:08:03 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:03 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4bca87cd-0417-40a1-a348-b46aecdd7d4e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Terminate volume connection completed successfully. Apr 24 17:08:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4bca87cd-0417-40a1-a348-b46aecdd7d4e tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Deleting attachment d5685e61-6aef-4104-ac6c-8584c44f064f. {{(pid=81986) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Acquiring lock "cinder-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Lock "cinder-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Acquiring lock "cinder-quobyte-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Lock "cinder-quobyte-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:04 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 1073741824" returned: 0 in 0.794s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e83b106-0771-4cbf-835f-505ec882100a]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:04 devstack sudo[86002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 Apr 24 17:08:04 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:04 devstack sudo[86001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf Apr 24 17:08:04 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "cinder-a8bdf6ad-acb9-46af-8fa5-0ced5140316b-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-a8bdf6ad-acb9-46af-8fa5-0ced5140316b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "cinder-quobyte-a8bdf6ad-acb9-46af-8fa5-0ced5140316b" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-quobyte-a8bdf6ad-acb9-46af-8fa5-0ced5140316b" acquired by "delete_volume" :: waited 0.028s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d293df-6f3d-4e47-9def-f09755ae3e10]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "cinder-e5c7387f-c35d-4953-b2d2-efb8d2f38a52-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "cinder-e5c7387f-c35d-4953-b2d2-efb8d2f38a52-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "cinder-quobyte-e5c7387f-c35d-4953-b2d2-efb8d2f38a52" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "cinder-quobyte-e5c7387f-c35d-4953-b2d2-efb8d2f38a52" acquired by "delete_volume" :: waited 0.025s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[1197b338-bcec-4317-b314-cc69cb3c804f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:04 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b Apr 24 17:08:04 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:04 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 Apr 24 17:08:05 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:05 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23" returned: 0 in 0.591s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597d7e08-a962-4867-b015-b7c817f32d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add98a85-420e-43c2-bafd-cb4b39aa5a23', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9969fdf-3312-403a-9a7f-fce4c359d1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:05 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Volume volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 (add98a85-420e-43c2-bafd-cb4b39aa5a23): created successfully Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9969fdf-3312-403a-9a7f-fce4c359d1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Flow 'volume_create_manager' (d2c626f8-4f12-4516-8e74-6dd87f450b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:05 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-416b0315-b7cf-48be-845c-038923a3d542 tempest-VolumesDeleteCascade-1268133307 None] Created volume successfully. Apr 24 17:08:05 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf" returned: 0 in 0.760s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:05 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf Apr 24 17:08:05 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:05 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b" returned: 0 in 0.782s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:05 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52" returned: 0 in 0.615s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:05 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b Apr 24 17:08:05 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:05 devstack sudo[86022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52 Apr 24 17:08:05 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-35b34dd2-4bce-4f91-9a07-2be4c650bfd5 tempest-BackendsCapabilitiesAdminTestsJSON-433211522 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81986) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 17:08:05 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf" returned: 0 in 0.527s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Lock "cinder-quobyte-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf" released by "delete_volume" :: held 1.332s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Created reservations ['685b545f-8282-4a63-99c6-de6323dbe3d5', '21b59da5-4a21-4473-a2fa-a764731b8cf1', '08282c6b-9d4c-45af-aedf-bb2d77d9a46c', 'd6fbbbcf-1911-4a6f-b8c6-20bb7f188f14'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:05 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:05 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:06 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e5c7387f-c35d-4953-b2d2-efb8d2f38a52" returned: 0 in 0.499s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "cinder-quobyte-e5c7387f-c35d-4953-b2d2-efb8d2f38a52" released by "delete_volume" :: held 1.153s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.quota [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Created reservations ['d9a66474-68f8-4865-bc89-aea0e630ee39', 'c23e6b4b-54ec-4719-8f3a-b90d181cee50', '5536cf0e-00f3-4c58-96f8-6930b146400c', '38ff2bf9-34c5-4777-89df-45dc4a570a1a'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:06 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] Creating offline snapshot e0aa052a-673f-494a-bb1d-6ea557a52dd8 of volume add98a85-420e-43c2-bafd-cb4b39aa5a23 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a8bdf6ad-acb9-46af-8fa5-0ced5140316b" returned: 0 in 0.641s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[711774f9-98da-4e74-b40a-c3dcc27c3137]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-quobyte-a8bdf6ad-acb9-46af-8fa5-0ced5140316b" released by "delete_volume" :: held 1.485s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ab382306-37a9-4136-8adb-34598baed923 tempest-BackendsCapabilitiesAdminTestsJSON-433211522 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81986) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:06 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 Apr 24 17:08:06 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:06 devstack sudo[86031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:06 devstack sudo[86031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Created reservations ['50b6f5c6-a531-40c5-b8d6-8931b4148857', '01a1ef5d-f09c-4d1b-9322-86c745859088', 'd94e8c2a-ac3b-4230-990a-4acf72537dd2', 'abc3a030-0fcb-4510-afca-07317ede782e'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:06 devstack sudo[86034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:06 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:06 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.648s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:06 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Deleted volume successfully. Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-26bc463f-cd8d-45e2-951b-54ea7a28e8e6 tempest-VolumesListAdminTestJSON-1448538723 None] Lock "cinder-9c0afd42-9d8d-4ee7-9b57-3e6966f3c2cf-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:06 devstack sudo[86031]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.606s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.manager [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:06 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Deleted volume successfully. Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-75b3ddc2-bdd7-42fa-8c55-962f22387aec req-4743fd60-d695-4d04-bf22-4dba7908a5be tempest-ServerBootFromVolumeStableRescueTest-1032431770 None] Lock "cinder-e5c7387f-c35d-4953-b2d2-efb8d2f38a52-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:06 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:06 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.547s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:06 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Deleted volume successfully. Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23" returned: 0 in 0.743s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:06 devstack sudo[86042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 1G Apr 24 17:08:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c36fc4a-eae8-4f6f-9e98-39800f0e7232 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-a8bdf6ad-acb9-46af-8fa5-0ced5140316b-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:06 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "cinder-9c10ed80-59b7-4904-8e52-bbe963158df5-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-9c10ed80-59b7-4904-8e52-bbe963158df5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "cinder-quobyte-9c10ed80-59b7-4904-8e52-bbe963158df5" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-quobyte-9c10ed80-59b7-4904-8e52-bbe963158df5" acquired by "delete_volume" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:07 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83c58b6-c98a-42d1-9807-7bc13e8da018]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:07 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5 Apr 24 17:08:07 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:07 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 1G" returned: 0 in 0.750s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:07 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 Apr 24 17:08:07 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:08 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5" returned: 0 in 0.702s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:08 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5 Apr 24 17:08:08 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:08 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8" returned: 0 in 0.650s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:08 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 is being set with open permissions: ugo+rw Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:08 devstack sudo[86060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 Apr 24 17:08:08 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:08 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9c10ed80-59b7-4904-8e52-bbe963158df5" returned: 0 in 0.600s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-quobyte-9c10ed80-59b7-4904-8e52-bbe963158df5" released by "delete_volume" :: held 1.371s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Created reservations ['d7d48256-0a81-4f27-8341-c39a95104d11', '8e3e4c28-9cc4-40d2-a5f5-cc992dc2eaeb', '144326ef-ff3c-4bc7-9f0a-b1b9977763e3', '5acea092-a00a-45de-9f33-e2d400d9d9fd'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:08 devstack sudo[86065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:08 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:08 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8" returned: 0 in 0.645s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:09 devstack sudo[86067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.info Apr 24 17:08:09 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:09 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.594s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:09 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Deleted volume successfully. Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-70663d5c-08cc-4d33-aceb-4ea0e7cb0020 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-9c10ed80-59b7-4904-8e52-bbe963158df5-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "cinder-971eb416-eafb-434d-8351-339019a28ce3-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:09 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.info" returned: 0 in 0.758s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:09 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.info is being set with open permissions: ugo+rw Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-971eb416-eafb-434d-8351-339019a28ce3-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:09 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.info Apr 24 17:08:09 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "cinder-quobyte-971eb416-eafb-434d-8351-339019a28ce3" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-quobyte-971eb416-eafb-434d-8351-339019a28ce3" acquired by "delete_volume" :: waited 0.032s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad118ddb-18cd-4f00-b32b-db4760cce602]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:10 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3 Apr 24 17:08:10 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:10 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.info" returned: 0 in 0.685s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.339s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:10 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-92e456c5-df3e-445c-b787-465e0c920c8c tempest-VolumesDeleteCascade-1268133307 None] Create snapshot completed successfully Apr 24 17:08:10 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3" returned: 0 in 0.624s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:10 devstack sudo[86110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3 Apr 24 17:08:10 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:11 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-971eb416-eafb-434d-8351-339019a28ce3" returned: 0 in 0.514s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-quobyte-971eb416-eafb-434d-8351-339019a28ce3" released by "delete_volume" :: held 1.188s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Created reservations ['c9be2016-d891-440a-9c60-e1281771da2c', 'ddd0d98c-b929-47d1-bad8-3e7e8eb3350e', 'bcd787be-6e7f-496d-a90b-6a5a3bc28fd1', 'caa58d4c-e818-4717-be31-4f4f44b1d2a8'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:11 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:11 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] Creating offline snapshot 2c6456cc-126b-4a97-a33a-b8773aa977b5 of volume add98a85-420e-43c2-bafd-cb4b39aa5a23 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e38849-965b-4a8f-ba85-f94674099374]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:11 devstack sudo[86117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 Apr 24 17:08:11 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:11 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.600s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:11 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Deleted volume successfully. Apr 24 17:08:11 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c5088298-7d88-499a-ae57-ddfc9731fe27 tempest-VolumesListAdminTestJSON-377934820 None] Lock "cinder-971eb416-eafb-434d-8351-339019a28ce3-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:12 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-25dadfce-c217-4d9c-afdb-55eff91e3883 tempest-GroupSnapshotsTest-134446929 None] Group tempest-GroupSnapshotsTest-Group-804483797: creating Apr 24 17:08:12 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-25dadfce-c217-4d9c-afdb-55eff91e3883 tempest-GroupSnapshotsTest-134446929 None] Group tempest-GroupSnapshotsTest-Group-804483797: created successfully Apr 24 17:08:12 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-25dadfce-c217-4d9c-afdb-55eff91e3883 tempest-GroupSnapshotsTest-134446929 None] Create group completed successfully. Apr 24 17:08:12 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8" returned: 0 in 0.688s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:12 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add98a85-420e-43c2-bafd-cb4b39aa5a23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:08:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:12 devstack sudo[86123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 1G Apr 24 17:08:12 devstack sudo[86123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:13 devstack sudo[86123]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 1G" returned: 0 in 0.808s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:13 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 Apr 24 17:08:13 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:13 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:08:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Flow 'volume_create_manager' (0e0f9e1f-ea03-4e76-84df-63a2462902b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5125a5f2-345e-4b86-a1cd-c057781d1e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5125a5f2-345e-4b86-a1cd-c057781d1e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-905152151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=098d83a6-5ef1-4ca9-9bb9-258117d3166f,host='devstack@QuobyteHD#QuobyteHD',id=5d27f435-5b52-49c0-ad00-7e16d305ee6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43fc6fdf394f019f04743b4f93082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:14Z,use_quota=True,user_id='d1cbbdbdf5774789a49cd6a0561f9754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c29b596-9e20-4f6b-a03c-0d17fd59540c),volume_type_id=5c29b596-9e20-4f6b-a03c-0d17fd59540c)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1acad4a-d129-4b11-b723-32b834b3f4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1acad4a-d129-4b11-b723-32b834b3f4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0e89ee-c487-497b-b1a5-6ba778117ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:14 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0e89ee-c487-497b-b1a5-6ba778117ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d27f435-5b52-49c0-ad00-7e16d305ee6b', 'volume_name': 'volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a9daa7-41ea-4273-a529-714091d9e163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a9daa7-41ea-4273-a529-714091d9e163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcbd0b6-92e3-4852-9f19-48c20c1de4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:14 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Volume 5d27f435-5b52-49c0-ad00-7e16d305ee6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b', 'volume_size': 1} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5" returned: 0 in 0.774s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:14 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 is being set with open permissions: ugo+rw Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:14 devstack sudo[86133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 Apr 24 17:08:14 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:14 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5" returned: 0 in 0.491s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.541s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=098d83a6-5ef1-4ca9-9bb9-258117d3166f,created_at=2026-04-24T15:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-905152151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=098d83a6-5ef1-4ca9-9bb9-258117d3166f,host='devstack@QuobyteHD#QuobyteHD',id=5d27f435-5b52-49c0-ad00-7e16d305ee6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43fc6fdf394f019f04743b4f93082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:14Z,use_quota=True,user_id='d1cbbdbdf5774789a49cd6a0561f9754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c29b596-9e20-4f6b-a03c-0d17fd59540c),volume_type_id=5c29b596-9e20-4f6b-a03c-0d17fd59540c)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Creating volume 5d27f435-5b52-49c0-ad00-7e16d305ee6b {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:14 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:14 devstack sudo[86136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b 1073741824 Apr 24 17:08:14 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:14 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a6d2d32d-c633-4aa4-9033-c0fc5555b908 tempest-VolumesDeleteCascade-1268133307 None] Create snapshot completed successfully Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-add98a85-420e-43c2-bafd-cb4b39aa5a23-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-add98a85-420e-43c2-bafd-cb4b39aa5a23-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Performing cascade delete. {{(pid=81986) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-2c6456cc-126b-4a97-a33a-b8773aa977b5-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-2c6456cc-126b-4a97-a33a-b8773aa977b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-quobyte-add98a85-420e-43c2-bafd-cb4b39aa5a23" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-add98a85-420e-43c2-bafd-cb4b39aa5a23" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-quobyte-2c6456cc-126b-4a97-a33a-b8773aa977b5" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-2c6456cc-126b-4a97-a33a-b8773aa977b5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Deleting offline snapshot 2c6456cc-126b-4a97-a33a-b8773aa977b5 of volume add98a85-420e-43c2-bafd-cb4b39aa5a23 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] snapshot_file for this snap is: volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb24af4a-92fa-4f2b-be33-133f954f43c7]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:15 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 Apr 24 17:08:15 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:15 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b 1073741824" returned: 0 in 1.004s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:15 devstack sudo[86143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b Apr 24 17:08:15 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:15 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5" returned: 0 in 0.806s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add98a85-420e-43c2-bafd-cb4b39aa5a23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[599c3498-514d-4613-8f57-44bd0df18327]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:16 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 Apr 24 17:08:16 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:16 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b" returned: 0 in 0.607s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcbd0b6-92e3-4852-9f19-48c20c1de4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03573e9d-35c2-47d3-a2f8-9420533296bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:16 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Volume volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b (5d27f435-5b52-49c0-ad00-7e16d305ee6b): created successfully Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03573e9d-35c2-47d3-a2f8-9420533296bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Flow 'volume_create_manager' (0e0f9e1f-ea03-4e76-84df-63a2462902b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:16 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-49f9a665-3b22-4b00-8563-6c33afe45cb5 tempest-GroupSnapshotsTest-134446929 None] Created volume successfully. Apr 24 17:08:16 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8" returned: 0 in 0.768s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add98a85-420e-43c2-bafd-cb4b39aa5a23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:16 devstack sudo[86155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 Apr 24 17:08:16 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Flow 'volume_create_manager' (c6297ac8-7c29-4591-bd1b-ea6aeec3d4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ce4963-4eaf-4dbc-b9e4-3c34565c1da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ce4963-4eaf-4dbc-b9e4-3c34565c1da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1156013327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd56c91-72b1-47a8-92af-d24797cb1050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9263581e89284a5ea4dd177377dbf951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:17Z,use_quota=True,user_id='35ca902390264fed9540cb1e52062612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cbfeaf-be5d-44c3-9315-561427e4c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cbfeaf-be5d-44c3-9315-561427e4c01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e20bcfd-9986-4644-bafb-cfb5345bd9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:16 devstack cinder-volume[81986]: DEBUG cinder.image.glance [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Creating Keystone auth plugin from conf {{(pid=81986) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e20bcfd-9986-4644-bafb-cfb5345bd9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3bd56c91-72b1-47a8-92af-d24797cb1050', 'volume_name': 'volume-3bd56c91-72b1-47a8-92af-d24797cb1050', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f149523-a5a1-47ee-9938-04d0c47bbe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f149523-a5a1-47ee-9938-04d0c47bbe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae94b58e-a741-45f7-95e4-561f9886fe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:17 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Volume 3bd56c91-72b1-47a8-92af-d24797cb1050: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3bd56c91-72b1-47a8-92af-d24797cb1050', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Trying to clone 3bd56c91-72b1-47a8-92af-d24797cb1050 from image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]). {{(pid=81986) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 17:08:17 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5" returned: 0 in 0.795s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:17 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5 Apr 24 17:08:17 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:17 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] GroupSnapshot 6672bfc2-3287-4980-99cd-182481ffc9a9: creating. Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] Group snapshot 6672bfc2-3287-4980-99cd-182481ffc9a9: creating. {{(pid=81986) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 17:08:17 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Image download 20.69 MB at 20.69 MB/s Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] Creating offline snapshot 697e7fe9-8ed4-4a25-8c38-1bf5916b204a of volume 5d27f435-5b52-49c0-ad00-7e16d305ee6b {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2050ca-412f-416e-b50e-8b6b562b184f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[150c316d-612e-4492-9bc1-0d9043decb87]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:17 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b Apr 24 17:08:17 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:17 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD Apr 24 17:08:17 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:18 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.2c6456cc-126b-4a97-a33a-b8773aa977b5" returned: 0 in 0.558s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-2c6456cc-126b-4a97-a33a-b8773aa977b5" released by "_delete_snapshot" :: held 3.068s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-add98a85-420e-43c2-bafd-cb4b39aa5a23" released by "delete_snapshot" :: held 3.121s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:18 devstack cinder-volume[81986]: WARNING cinder.quota [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Created reservations ['50a1eaee-3105-4c13-af32-7115f3c611b6', '01213927-f7aa-4437-983f-938a749ee984', '52c930b4-096c-416f-9ea7-c96aa541b5e6', '15f5ca76-1533-4e47-b4ff-d713cfbde8ee'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:18 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Delete snapshot completed successfully. Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-2c6456cc-126b-4a97-a33a-b8773aa977b5-delete_snapshot" released by "delete_snapshot" :: held 3.376s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-e0aa052a-673f-494a-bb1d-6ea557a52dd8-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:18 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD" returned: 0 in 0.685s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Temporary image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 is fetched for user 35ca902390264fed9540cb1e52062612. {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-e0aa052a-673f-494a-bb1d-6ea557a52dd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-quobyte-add98a85-420e-43c2-bafd-cb4b39aa5a23" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:18 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-add98a85-420e-43c2-bafd-cb4b39aa5a23" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-quobyte-e0aa052a-673f-494a-bb1d-6ea557a52dd8" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b" returned: 0 in 0.750s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-e0aa052a-673f-494a-bb1d-6ea557a52dd8" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Deleting offline snapshot e0aa052a-673f-494a-bb1d-6ea557a52dd8 of volume add98a85-420e-43c2-bafd-cb4b39aa5a23 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:08:18 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a 1G Apr 24 17:08:18 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] snapshot_file for this snap is: volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[84012d9b-158c-4652-9b97-44649b760661]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[0323019b-e471-4bfd-ae84-da313174682d]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:18 devstack sudo[86176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 Apr 24 17:08:18 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:18 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD Apr 24 17:08:18 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:19 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8" returned: 0 in 0.700s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add98a85-420e-43c2-bafd-cb4b39aa5a23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:08:19 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD" returned: 0 in 0.689s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:19 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a 1G" returned: 0 in 0.820s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c61542-0020-453a-8a35-b8e3b8402960]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:19 devstack sudo[86191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a Apr 24 17:08:19 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:19 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 Apr 24 17:08:19 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:19 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a" returned: 0 in 0.610s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:19 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:19 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23" returned: 0 in 0.612s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:19 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a Apr 24 17:08:19 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:19 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 Apr 24 17:08:19 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:20 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a" returned: 0 in 0.587s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:20 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.info Apr 24 17:08:20 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:20 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8" returned: 0 in 0.655s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:20 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8 Apr 24 17:08:20 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:21 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.info" returned: 0 in 0.581s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:21 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:21 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23.e0aa052a-673f-494a-bb1d-6ea557a52dd8" returned: 0 in 0.542s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:21 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.info Apr 24 17:08:21 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-e0aa052a-673f-494a-bb1d-6ea557a52dd8" released by "_delete_snapshot" :: held 2.652s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-add98a85-420e-43c2-bafd-cb4b39aa5a23" released by "delete_snapshot" :: held 2.694s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Created reservations ['75183166-760f-486c-b60c-0f86e41742fd', '8f440d58-3dcf-435c-891e-7a3c1ff7211c', 'c8882b97-0d27-47e6-af38-07320b409405', '06253de5-b080-4b6a-b1ac-34f5beef47f4'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:21 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Delete snapshot completed successfully. Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-e0aa052a-673f-494a-bb1d-6ea557a52dd8-delete_snapshot" released by "delete_snapshot" :: held 2.880s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Snapshots deleted, issuing volume delete {{(pid=81986) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-quobyte-add98a85-420e-43c2-bafd-cb4b39aa5a23" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-add98a85-420e-43c2-bafd-cb4b39aa5a23" acquired by "delete_volume" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a78a5d-a273-4575-bf43-43331b8e3f02]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:21 devstack sudo[86217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 Apr 24 17:08:21 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:21 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.info" returned: 0 in 0.576s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.020s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.425s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1156013327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd56c91-72b1-47a8-92af-d24797cb1050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9263581e89284a5ea4dd177377dbf951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:17Z,use_quota=True,user_id='35ca902390264fed9540cb1e52062612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Creating volume 3bd56c91-72b1-47a8-92af-d24797cb1050 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:21 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:08:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:21 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 1073741824 Apr 24 17:08:21 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:21 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-feb37284-1181-45c3-80d2-176b3f41add2 tempest-GroupSnapshotsTest-134446929 None] group_snapshot 6672bfc2-3287-4980-99cd-182481ffc9a9: created successfully Apr 24 17:08:22 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23" returned: 0 in 0.656s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:22 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23 Apr 24 17:08:22 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Flow 'volume_create_manager' (d28b6eb7-d6d1-4833-85bc-b9f2c39e2369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b2311b-bc3f-4f90-b808-f4a02ecba124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b2311b-bc3f-4f90-b808-f4a02ecba124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1651541596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d277fc01-8a2a-411e-85c3-9c676b8d47e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb9faf871644bd9b5365c567b6baf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:22Z,use_quota=True,user_id='04faf07fb2b6466da482cffe1359d427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ec9894-b0de-498f-8361-fbb901dde53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ec9894-b0de-498f-8361-fbb901dde53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda1fefd-9345-4bf4-b582-563bb984050f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda1fefd-9345-4bf4-b582-563bb984050f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd277fc01-8a2a-411e-85c3-9c676b8d47e4', 'volume_name': 'volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4106c693-5ede-43bd-a741-cf2eda436970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4106c693-5ede-43bd-a741-cf2eda436970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90936d3-0512-4fe3-a93c-e336388a78fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:22 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Volume d277fc01-8a2a-411e-85c3-9c676b8d47e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4', 'volume_size': 1} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:22 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 1073741824" returned: 0 in 0.778s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:22 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 Apr 24 17:08:22 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:22 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-add98a85-420e-43c2-bafd-cb4b39aa5a23" returned: 0 in 0.606s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-add98a85-420e-43c2-bafd-cb4b39aa5a23" released by "delete_volume" :: held 1.314s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Created reservations ['27dac591-8b99-4a86-a1a5-63f0a6b4d3a6', '32d048ae-16fb-4316-8c21-1d450ea893ea', 'b18694aa-36a5-4e15-b3f8-3133181c3a25', 'bd14fe7f-4fc8-4839-9a73-2a16e1d75ae5'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:22 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:22 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:23 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050" returned: 0 in 0.588s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1651541596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d277fc01-8a2a-411e-85c3-9c676b8d47e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb9faf871644bd9b5365c567b6baf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:22Z,use_quota=True,user_id='04faf07fb2b6466da482cffe1359d427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Creating volume d277fc01-8a2a-411e-85c3-9c676b8d47e4 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:23 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:23 devstack sudo[86238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 1073741824 Apr 24 17:08:23 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Attempting download of 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}])) to volume 3bd56c91-72b1-47a8-92af-d24797cb1050. {{(pid=81986) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02e3726-10d9-4246-834a-56989910fe75]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zl6f59g5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:23 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zl6f59g5 Apr 24 17:08:23 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:23 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.599s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:23 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Deleted volume successfully. Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1682efd4-d114-4bf2-8458-978c8bcecd4c tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-add98a85-420e-43c2-bafd-cb4b39aa5a23-delete_volume" released by "delete_volume" :: held 8.461s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:23 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zl6f59g5" returned: 0 in 0.633s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zl6f59g5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:23 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 1073741824" returned: 0 in 0.794s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:24 devstack sudo[86248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zl6f59g5 Apr 24 17:08:24 devstack sudo[86248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:24 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 Apr 24 17:08:24 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Flow 'volume_create_manager' (e6e5d48d-4552-4f14-9537-3ef4c8bb1a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6179ab35-375b-4114-ad1a-f63a0267e78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6179ab35-375b-4114-ad1a-f63a0267e78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1311936955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722b17e0-1df8-42d9-91bd-74089c8e3a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea0ac1d411d4f2b8c10e1f558eb5061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:24Z,use_quota=True,user_id='a3490d4bc2a049cebbee715f35c6ae2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48a68d1-8b3f-4be0-8f32-cbf25796878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48a68d1-8b3f-4be0-8f32-cbf25796878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae75d16e-a552-4004-a0bf-cc0e71b7e4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae75d16e-a552-4004-a0bf-cc0e71b7e4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722b17e0-1df8-42d9-91bd-74089c8e3a3e', 'volume_name': 'volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f886b5-b367-41ab-bc23-9d0665092455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f886b5-b367-41ab-bc23-9d0665092455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e16f171-8045-426f-9cd9-22bfd849bfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:24 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Volume 722b17e0-1df8-42d9-91bd-74089c8e3a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e', 'volume_size': 1} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:24 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:24 devstack sudo[86248]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4" returned: 0 in 0.618s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.272s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-697e7fe9-8ed4-4a25-8c38-1bf5916b204a-8938380f-c0eb-4b6f-9c97-2fef2a992e81" by "_create_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zl6f59g5" returned: 1 in 0.718s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zl6f59g5' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90936d3-0512-4fe3-a93c-e336388a78fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b88e6d9-d167-4834-b84b-b11693612a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d293196-a8ba-46a1-9b01-760223491ecc]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:24 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Volume volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 (d277fc01-8a2a-411e-85c3-9c676b8d47e4): created successfully Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b88e6d9-d167-4834-b84b-b11693612a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Flow 'volume_create_manager' (d28b6eb7-d6d1-4833-85bc-b9f2c39e2369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-697e7fe9-8ed4-4a25-8c38-1bf5916b204a-8938380f-c0eb-4b6f-9c97-2fef2a992e81" acquired by "_create_volume_from_snapshot" :: waited 0.063s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Creating volume 8938380f-c0eb-4b6f-9c97-2fef2a992e81 from snapshot 697e7fe9-8ed4-4a25-8c38-1bf5916b204a {{(pid=81986) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-8938380f-c0eb-4b6f-9c97-2fef2a992e81" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:24 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-20c812ee-4d3a-4bd5-846d-b09a82dd925b req-dc2f659e-56a4-4eb4-b206-80f0c223269b tempest-VolumesSnapshotsTestJSON-77169184 None] Created volume successfully. Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-8938380f-c0eb-4b6f-9c97-2fef2a992e81" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] snapshot: 697e7fe9-8ed4-4a25-8c38-1bf5916b204a, volume: 8938380f-c0eb-4b6f-9c97-2fef2a992e81, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:08:24 devstack sudo[86255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD Apr 24 17:08:24 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d48323-aaa9-4318-a64c-b568b482bd88]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:24 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a Apr 24 17:08:24 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:25 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:25 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 was qcow2, converting to raw {{(pid=81986) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 17:08:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:25 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 Apr 24 17:08:25 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:25 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a" returned: 0 in 0.579s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:08:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:08:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:08:25 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a79e7c-832e-42e4-b221-d33dc312c945]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:25 devstack sudo[86267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b Apr 24 17:08:25 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:25 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:INSERT=30,cinder:UPDATE=185,cinder:SELECT=124,cinder:DELETE=11 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:08:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:26 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b" returned: 0 in 0.595s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:26 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81 not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:08:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:26 devstack sudo[86278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81 Apr 24 17:08:26 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:26 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050" returned: 0 in 1.592s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:26 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_sf4urhvbdevstack@QuobyteHD, size 112.00 MB, duration 1.60 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:08:26 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Converted 112.00 MB image at 70.19 MB/s Apr 24 17:08:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:26 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 1G Apr 24 17:08:26 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:27 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 1G" returned: 0 in 1.133s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ba9bea-8a10-4292-966c-1131b2ed6c94]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:28 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 Apr 24 17:08:28 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:29 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050" returned: 0 in 1.128s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:29 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 Apr 24 17:08:29 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:30 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050" returned: 1 in 1.092s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Downloaded image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}])) to volume 3bd56c91-72b1-47a8-92af-d24797cb1050 successfully. {{(pid=81986) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Temporary image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 for user 35ca902390264fed9540cb1e52062612 is deleted. {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Marking volume 3bd56c91-72b1-47a8-92af-d24797cb1050 as bootable. {{(pid=81986) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=124,cinder:UPDATE=150,cinder:DELETE=17,cinder:INSERT=49 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Copying metadata from image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 to 3bd56c91-72b1-47a8-92af-d24797cb1050. {{(pid=81986) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Creating volume glance metadata for volume 3bd56c91-72b1-47a8-92af-d24797cb1050 backed by image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81986) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae94b58e-a741-45f7-95e4-561f9886fe96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd56c91-72b1-47a8-92af-d24797cb1050', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e65c8d-188f-44eb-bd2b-165569dad85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:30 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Volume volume-3bd56c91-72b1-47a8-92af-d24797cb1050 (3bd56c91-72b1-47a8-92af-d24797cb1050): created successfully Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e65c8d-188f-44eb-bd2b-165569dad85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Flow 'volume_create_manager' (c6297ac8-7c29-4591-bd1b-ea6aeec3d4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:30 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f6bd8bd7-c4d3-4260-af00-160d5c44897a tempest-VolumesImageMetadata-1275832167 None] Created volume successfully. Apr 24 17:08:31 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81" returned: 0 in 5.231s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[355d6221-ae4b-4352-9631-d6f3d0bcbd09]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:31 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b Apr 24 17:08:31 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Acquiring lock "cinder-3bd56c91-72b1-47a8-92af-d24797cb1050-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Lock "cinder-3bd56c91-72b1-47a8-92af-d24797cb1050-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Acquiring lock "cinder-quobyte-3bd56c91-72b1-47a8-92af-d24797cb1050" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Lock "cinder-quobyte-3bd56c91-72b1-47a8-92af-d24797cb1050" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b810f45-b6f7-4434-a71f-e988932593a3]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:31 devstack sudo[86321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 Apr 24 17:08:31 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:31 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b" returned: 0 in 0.696s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:08:31 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Converted 1024.00 MB image at 195.71 MB/s Apr 24 17:08:31 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:08:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:31 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81 Apr 24 17:08:31 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:32 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050" returned: 0 in 0.537s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:32 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 Apr 24 17:08:32 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:32 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81" returned: 0 in 0.469s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-8938380f-c0eb-4b6f-9c97-2fef2a992e81" released by "_copy_volume_from_snapshot" :: held 7.694s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-697e7fe9-8ed4-4a25-8c38-1bf5916b204a-8938380f-c0eb-4b6f-9c97-2fef2a992e81" released by "_create_volume_from_snapshot" :: held 7.734s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.798s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.915s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1311936955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722b17e0-1df8-42d9-91bd-74089c8e3a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea0ac1d411d4f2b8c10e1f558eb5061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:24Z,use_quota=True,user_id='a3490d4bc2a049cebbee715f35c6ae2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Creating volume 722b17e0-1df8-42d9-91bd-74089c8e3a3e {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:32 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:32 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e 1073741824 Apr 24 17:08:32 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:32 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-abef5c74-a1e2-40c0-b040-030700cd2235 tempest-GroupSnapshotsTest-134446929 None] Create group from source-snapshot-6672bfc2-3287-4980-99cd-182481ffc9a9 completed successfully. Apr 24 17:08:32 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050" returned: 1 in 0.551s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:08:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:32 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050 Apr 24 17:08:32 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:33 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e 1073741824" returned: 0 in 0.662s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:33 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3bd56c91-72b1-47a8-92af-d24797cb1050" returned: 0 in 0.518s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Lock "cinder-quobyte-3bd56c91-72b1-47a8-92af-d24797cb1050" released by "delete_volume" :: held 1.666s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:33 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e Apr 24 17:08:33 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Created reservations ['7bde67bc-c67e-42b9-80c8-6fb30707457c', '9c8a5281-d484-43ae-9ee8-f2b065ec469e', 'f9f51865-2123-4e2a-b2c0-9c279091df38', '7c335e9c-1146-4f1f-8ba1-972c481c879e'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:33 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:33 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-8938380f-c0eb-4b6f-9c97-2fef2a992e81" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-8938380f-c0eb-4b6f-9c97-2fef2a992e81" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:33 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e" returned: 0 in 0.558s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[830dae85-d1f8-421e-976c-a4ae5cf9d33e]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e16f171-8045-426f-9cd9-22bfd849bfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7b8c1d-de7c-4826-873a-a138fd48179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:33 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Volume volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e (722b17e0-1df8-42d9-91bd-74089c8e3a3e): created successfully Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7b8c1d-de7c-4826-873a-a138fd48179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Flow 'volume_create_manager' (e6e5d48d-4552-4f14-9537-3ef4c8bb1a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:33 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-47028348-f2c5-4704-b4f1-2a21b3b2de10 tempest-VolumesDeleteCascade-1268133307 None] Created volume successfully. Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] Creating offline snapshot 3d2eaf70-e368-4657-9699-7c2cc23e641b of volume d277fc01-8a2a-411e-85c3-9c676b8d47e4 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:08:33 devstack sudo[86349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81 Apr 24 17:08:33 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddaa7cf-b0f8-4bf0-bf4f-cc42ca7c2af1]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:33 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.596s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:33 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Deleted volume successfully. Apr 24 17:08:33 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 Apr 24 17:08:33 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-dbe13cbe-3dad-4f0f-98bb-ef4951f2ebb2 tempest-VolumesImageMetadata-1275832167 None] Lock "cinder-3bd56c91-72b1-47a8-92af-d24797cb1050-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:34 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81" returned: 0 in 0.574s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:34 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81 Apr 24 17:08:34 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:34 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4" returned: 0 in 0.787s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:34 devstack sudo[86362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b 1G Apr 24 17:08:34 devstack sudo[86362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:34 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8938380f-c0eb-4b6f-9c97-2fef2a992e81" returned: 0 in 0.650s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-8938380f-c0eb-4b6f-9c97-2fef2a992e81" released by "delete_volume" :: held 1.275s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Created reservations ['941dfbb2-11b9-488e-9f2f-a3f783f240b5'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:35 devstack cinder-volume[81986]: WARNING cinder.quota [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1634310139 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1634310139, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:08:35 devstack cinder-volume[81986]: WARNING cinder.quota [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1634310139 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1634310139, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Created reservations ['1267eeb5-6134-4630-97f1-ef7cc9d37be0', '7bd7f0a9-b61d-4b75-879d-e4d97b13bd42', 'fa8e0505-4334-4590-8cbb-f28fbf312007', '7c6e81e6-2235-4f62-8864-d506472a880a'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:35 devstack sudo[86374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:35 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:35 devstack sudo[86362]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b 1G" returned: 0 in 0.761s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:35 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b Apr 24 17:08:35 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:35 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.533s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:35 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b5c1043f-44a3-4b98-9722-7812520755a5 tempest-GroupSnapshotsTest-134446929 None] Delete group completed successfully. Apr 24 17:08:35 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b" returned: 0 in 0.591s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:35 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b is being set with open permissions: ugo+rw Apr 24 17:08:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:36 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b Apr 24 17:08:36 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:36 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] group_snapshot 6672bfc2-3287-4980-99cd-182481ffc9a9: deleting Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] group_snapshot 6672bfc2-3287-4980-99cd-182481ffc9a9: deleting {{(pid=81986) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-5d27f435-5b52-49c0-ad00-7e16d305ee6b" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-5d27f435-5b52-49c0-ad00-7e16d305ee6b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-697e7fe9-8ed4-4a25-8c38-1bf5916b204a" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-697e7fe9-8ed4-4a25-8c38-1bf5916b204a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Deleting offline snapshot 697e7fe9-8ed4-4a25-8c38-1bf5916b204a of volume 5d27f435-5b52-49c0-ad00-7e16d305ee6b {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] snapshot_file for this snap is: volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[068765fd-c68e-4e7c-aca6-6eae2b954fa0]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:36 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a Apr 24 17:08:36 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Flow 'volume_create_manager' (cc696685-0001-4b4e-a6fe-1f834da51707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5f0e83-3ef6-4d84-babd-24e007b32a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5f0e83-3ef6-4d84-babd-24e007b32a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-907064860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03c97e0-b2c5-4196-98db-754387bff6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b39ee2f0f4b4071a2fadb08864166bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:36Z,use_quota=True,user_id='73f430c0dbc54190a84b68aac300ddfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038792fe-f54d-47c2-88b9-e6c03cf0d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038792fe-f54d-47c2-88b9-e6c03cf0d451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f973bf-a1f4-4fd2-8e58-497217bf3a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f973bf-a1f4-4fd2-8e58-497217bf3a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03c97e0-b2c5-4196-98db-754387bff6c1', 'volume_name': 'volume-e03c97e0-b2c5-4196-98db-754387bff6c1', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af96d63a-56d6-4bd3-8b2d-e42004bfa6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af96d63a-56d6-4bd3-8b2d-e42004bfa6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b438fdc3-b7d2-406b-b7d7-1f8e5f51a7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:36 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Volume e03c97e0-b2c5-4196-98db-754387bff6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03c97e0-b2c5-4196-98db-754387bff6c1', 'volume_size': 1} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:36 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b" returned: 0 in 0.583s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:36 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.info Apr 24 17:08:36 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:36 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a" returned: 0 in 0.617s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b440200-b2d0-4b15-b069-d22022374fcc]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:36 devstack sudo[86392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b Apr 24 17:08:36 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:37 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.info" returned: 0 in 0.456s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:37 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.info is being set with open permissions: ugo+rw Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:37 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.info Apr 24 17:08:37 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:37 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b" returned: 0 in 0.500s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:37 devstack sudo[86400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a Apr 24 17:08:37 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:37 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.info" returned: 0 in 0.478s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.820s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.991s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] Creating offline snapshot 193f605b-400a-4a5e-95b2-9f590099d3ec of volume 722b17e0-1df8-42d9-91bd-74089c8e3a3e {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6fe537-a742-41a9-9f0a-a05b97b96901]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:37 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-7526d6a7-9588-4ef0-bb4f-be646a7f16f2 req-01be1185-2163-4a6b-8b87-c0815c48829a tempest-VolumesSnapshotsTestJSON-77169184 None] Create snapshot completed successfully Apr 24 17:08:37 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e Apr 24 17:08:37 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:37 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a" returned: 0 in 0.563s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:37 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a Apr 24 17:08:37 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:38 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e" returned: 0 in 0.530s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:38 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec 1G Apr 24 17:08:38 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:38 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b.697e7fe9-8ed4-4a25-8c38-1bf5916b204a" returned: 0 in 0.451s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-697e7fe9-8ed4-4a25-8c38-1bf5916b204a" released by "_delete_snapshot" :: held 2.232s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-5d27f435-5b52-49c0-ad00-7e16d305ee6b" released by "delete_snapshot" :: held 2.256s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:38 devstack cinder-volume[81986]: WARNING cinder.quota [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1634310139 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1634310139, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] Created reservations ['cac9a1e7-0345-4082-85fa-efe479021022', 'ccb29061-80ab-46bd-9828-ef5bbe2cc12d', '7e7559ec-2d12-49ba-8b47-01e31dd44170', 'b3ae9793-1c8c-440c-aa48-d5264299e407'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:38 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-6c172c2d-85e8-4320-b480-cc741676cb65 tempest-GroupSnapshotsTest-134446929 None] group_snapshot 6672bfc2-3287-4980-99cd-182481ffc9a9: deleted successfully Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Acquiring lock "cinder-3d2eaf70-e368-4657-9699-7c2cc23e641b-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "cinder-3d2eaf70-e368-4657-9699-7c2cc23e641b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Acquiring lock "cinder-quobyte-d277fc01-8a2a-411e-85c3-9c676b8d47e4" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "cinder-quobyte-d277fc01-8a2a-411e-85c3-9c676b8d47e4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Acquiring lock "cinder-quobyte-3d2eaf70-e368-4657-9699-7c2cc23e641b" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "cinder-quobyte-3d2eaf70-e368-4657-9699-7c2cc23e641b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Deleting offline snapshot 3d2eaf70-e368-4657-9699-7c2cc23e641b of volume d277fc01-8a2a-411e-85c3-9c676b8d47e4 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:08:38 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] snapshot_file for this snap is: volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec 1G" returned: 0 in 0.683s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4adc38a-f645-44ca-baf0-88ebf08dc6c4]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:38 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec Apr 24 17:08:38 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:38 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b Apr 24 17:08:38 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:39 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec" returned: 0 in 0.482s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:39 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec is being set with open permissions: ugo+rw Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:39 devstack sudo[86430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec Apr 24 17:08:39 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:39 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b" returned: 0 in 0.534s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0666f5-66f5-4eff-8ec6-a3e6fcf463a9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:39 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 Apr 24 17:08:39 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-5d27f435-5b52-49c0-ad00-7e16d305ee6b" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-5d27f435-5b52-49c0-ad00-7e16d305ee6b" acquired by "delete_volume" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb69cf5-3477-43f3-9e14-599226b8bbd0]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:39 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b Apr 24 17:08:39 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:39 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec" returned: 0 in 0.487s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:39 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.info Apr 24 17:08:39 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:39 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4" returned: 0 in 0.578s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:39 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b Apr 24 17:08:39 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:40 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b" returned: 0 in 0.560s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:40 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b Apr 24 17:08:40 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:40 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.info" returned: 0 in 0.470s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:40 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.info is being set with open permissions: ugo+rw Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:40 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.info Apr 24 17:08:40 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:40 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b" returned: 0 in 0.545s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:40 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b Apr 24 17:08:40 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:40 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5d27f435-5b52-49c0-ad00-7e16d305ee6b" returned: 0 in 0.449s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-5d27f435-5b52-49c0-ad00-7e16d305ee6b" released by "delete_volume" :: held 1.083s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Created reservations ['ec4df9d2-ab6f-441e-9d4e-e066c0a99f33'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:40 devstack cinder-volume[81986]: WARNING cinder.db.sqlalchemy.api [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1634310139'] Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Created reservations ['1a522741-c24f-4780-8e5d-e83f27866352', '99e94d4b-60fd-4c42-91c2-70b3260e28e0', '0d109a6f-5360-4b56-b0d1-8f1335a4a9ce', '465a4436-129c-49de-b39c-cdec424009af'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:40 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.info" returned: 0 in 0.560s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.315s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.410s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-907064860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03c97e0-b2c5-4196-98db-754387bff6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b39ee2f0f4b4071a2fadb08864166bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:36Z,use_quota=True,user_id='73f430c0dbc54190a84b68aac300ddfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Creating volume e03c97e0-b2c5-4196-98db-754387bff6c1 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:40 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:40 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 1073741824 Apr 24 17:08:40 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:40 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-11ee3072-6c51-4feb-8c0a-7e17b56ce104 tempest-VolumesDeleteCascade-1268133307 None] Create snapshot completed successfully Apr 24 17:08:40 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:40 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:41 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4.3d2eaf70-e368-4657-9699-7c2cc23e641b" returned: 0 in 0.545s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "cinder-quobyte-3d2eaf70-e368-4657-9699-7c2cc23e641b" released by "_delete_snapshot" :: held 2.310s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "cinder-quobyte-d277fc01-8a2a-411e-85c3-9c676b8d47e4" released by "delete_snapshot" :: held 2.335s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:41 devstack cinder-volume[81986]: DEBUG cinder.quota [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Created reservations ['2f2ea12e-6e62-4dbb-ad6e-d8cec366be1d', 'c4a7b45d-94f6-4fa0-8bb8-6799d159c227', 'a1a608af-9fd6-4cc7-88ab-c5359ee372d1', '617bccac-7fce-496b-a613-d4c3eb863259'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:41 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Delete snapshot completed successfully. Apr 24 17:08:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-ad637cc6-94bd-4d71-bd6b-25eb6cc40935 req-4755a267-11b2-44d1-b579-4b60ac05d762 tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "cinder-3d2eaf70-e368-4657-9699-7c2cc23e641b-delete_snapshot" released by "delete_snapshot" :: held 2.467s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:41 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.496s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:41 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:41 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-fec07e96-2d05-4870-83fa-46a88d0ba16a tempest-GroupSnapshotsTest-134446929 None] Delete group completed successfully. Apr 24 17:08:41 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 1073741824" returned: 0 in 0.670s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:41 devstack sudo[86470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 Apr 24 17:08:41 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:42 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1" returned: 0 in 0.473s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b438fdc3-b7d2-406b-b7d7-1f8e5f51a7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03c97e0-b2c5-4196-98db-754387bff6c1', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a69c4ec-f6d1-4412-b6ea-6648c1483bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Acquiring lock "cinder-d277fc01-8a2a-411e-85c3-9c676b8d47e4-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:42 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Volume volume-e03c97e0-b2c5-4196-98db-754387bff6c1 (e03c97e0-b2c5-4196-98db-754387bff6c1): created successfully Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a69c4ec-f6d1-4412-b6ea-6648c1483bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Flow 'volume_create_manager' (cc696685-0001-4b4e-a6fe-1f834da51707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "cinder-d277fc01-8a2a-411e-85c3-9c676b8d47e4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:42 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-064968c3-72eb-47c0-bd5b-84116aa5c696 tempest-SnapshotMetadataTestJSON-841669444 None] Created volume successfully. Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Acquiring lock "cinder-quobyte-d277fc01-8a2a-411e-85c3-9c676b8d47e4" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "cinder-quobyte-d277fc01-8a2a-411e-85c3-9c676b8d47e4" acquired by "delete_volume" :: waited 0.039s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[247b19b4-ce6a-4680-bf15-24a5d1d63dc9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:08:42 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b7642878-73b4-4c88-9562-26b6811e0f11 tempest-GroupSnapshotsTest-134446929 None] Group tempest-GroupSnapshotsTest-Group-1483223899: creating Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Flow 'volume_create_manager' (80c27c8c-6258-4959-ac21-a606f97bbb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bf3744-15c5-421b-9515-18941e981628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:42 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 Apr 24 17:08:42 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bf3744-15c5-421b-9515-18941e981628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1716292704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8701db33-af09-4333-ac59-9ed8af106fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea0ac1d411d4f2b8c10e1f558eb5061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=193f605b-400a-4a5e-95b2-9f590099d3ec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:42Z,use_quota=True,user_id='a3490d4bc2a049cebbee715f35c6ae2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b831c1f0-9f0e-401b-a329-da67c1b273ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b831c1f0-9f0e-401b-a329-da67c1b273ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1261d0cd-b841-404b-94e7-df5725a82141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1261d0cd-b841-404b-94e7-df5725a82141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8701db33-af09-4333-ac59-9ed8af106fc3', 'volume_name': 'volume-8701db33-af09-4333-ac59-9ed8af106fc3', 'volume_size': 1, 'snapshot_id': '193f605b-400a-4a5e-95b2-9f590099d3ec'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc368d9c-df97-4968-a297-c10b451c5560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc368d9c-df97-4968-a297-c10b451c5560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e2d3e9-0111-473e-aa94-5138e57950bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:42 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Volume 8701db33-af09-4333-ac59-9ed8af106fc3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8701db33-af09-4333-ac59-9ed8af106fc3', 'volume_size': 1, 'snapshot_id': '193f605b-400a-4a5e-95b2-9f590099d3ec'} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-quobyte-193f605b-400a-4a5e-95b2-9f590099d3ec-8701db33-af09-4333-ac59-9ed8af106fc3" by "_create_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:42 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b7642878-73b4-4c88-9562-26b6811e0f11 tempest-GroupSnapshotsTest-134446929 None] Group tempest-GroupSnapshotsTest-Group-1483223899: created successfully Apr 24 17:08:42 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b7642878-73b4-4c88-9562-26b6811e0f11 tempest-GroupSnapshotsTest-134446929 None] Create group completed successfully. Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-193f605b-400a-4a5e-95b2-9f590099d3ec-8701db33-af09-4333-ac59-9ed8af106fc3" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Creating volume 8701db33-af09-4333-ac59-9ed8af106fc3 from snapshot 193f605b-400a-4a5e-95b2-9f590099d3ec {{(pid=81986) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-quobyte-8701db33-af09-4333-ac59-9ed8af106fc3" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-8701db33-af09-4333-ac59-9ed8af106fc3" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] snapshot: 193f605b-400a-4a5e-95b2-9f590099d3ec, volume: 8701db33-af09-4333-ac59-9ed8af106fc3, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[dece46a4-693a-4ed6-ab0c-6db45fd361f9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:42 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec Apr 24 17:08:42 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:42 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4" returned: 0 in 0.619s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:42 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4 Apr 24 17:08:42 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:43 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec" returned: 0 in 0.611s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5492897-325b-4d2e-9927-a390bd01edcb]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:43 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e Apr 24 17:08:43 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:43 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d277fc01-8a2a-411e-85c3-9c676b8d47e4" returned: 0 in 0.532s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "cinder-quobyte-d277fc01-8a2a-411e-85c3-9c676b8d47e4" released by "delete_volume" :: held 1.247s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.quota [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Created reservations ['99cbfb0c-e29c-41f8-81b6-54feb6f1e8f4', '45fae863-694a-4277-8f86-30c9579694e1', '1c69bcd4-ecf2-4124-b250-8080affc5def', 'cee97957-b03f-48b6-b135-19b03549bc33'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:43 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:43 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Flow 'volume_create_manager' (c9650e89-cfef-4268-b6f7-e9f9af167f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:43 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565d3da0-9d36-49d8-b248-a5eea3cdcb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e" returned: 0 in 0.693s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3 not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:43 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3 Apr 24 17:08:43 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565d3da0-9d36-49d8-b248-a5eea3cdcb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1529840134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d415ea9-1926-4653-b6ef-be5c8294f51c,host='devstack@QuobyteHD#QuobyteHD',id=d433c845-9b04-4323-9659-768f60aa5384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43fc6fdf394f019f04743b4f93082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:44Z,use_quota=True,user_id='d1cbbdbdf5774789a49cd6a0561f9754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cc71b23-b137-4012-bffb-0dde64520e11),volume_type_id=7cc71b23-b137-4012-bffb-0dde64520e11)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908bca0c-b19d-4a1f-ba2a-c852ecf17ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908bca0c-b19d-4a1f-ba2a-c852ecf17ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c1b8da-0e30-40d3-a532-08811cc21d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c1b8da-0e30-40d3-a532-08811cc21d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd433c845-9b04-4323-9659-768f60aa5384', 'volume_name': 'volume-d433c845-9b04-4323-9659-768f60aa5384', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfb490d-f062-454d-8c3f-a268706f2650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfb490d-f062-454d-8c3f-a268706f2650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901df8c5-b5f3-455b-b931-4cde63c60489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:43 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Volume d433c845-9b04-4323-9659-768f60aa5384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d433c845-9b04-4323-9659-768f60aa5384', 'volume_size': 1} Apr 24 17:08:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:44 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.509s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:44 devstack cinder-volume[81986]: DEBUG cinder.manager [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:44 devstack cinder-volume[81986]: INFO cinder.volume.manager [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Deleted volume successfully. Apr 24 17:08:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [req-0e19d57f-8d58-416e-8647-709b84a7dd13 req-147e6ba2-0884-49a9-a3fe-20f1df37558e tempest-VolumesSnapshotsTestJSON-77169184 None] Lock "cinder-d277fc01-8a2a-411e-85c3-9c676b8d47e4-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:49 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3" returned: 0 in 5.546s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:49 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[410effc4-a9f2-4350-8fac-36d2b416f719]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:49 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e Apr 24 17:08:49 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:50 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e" returned: 0 in 0.692s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:08:50 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Converted 1024.00 MB image at 184.59 MB/s Apr 24 17:08:50 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3 is being set with open permissions: ugo+rw Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:50 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3 Apr 24 17:08:50 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:50 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3" returned: 0 in 0.514s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-8701db33-af09-4333-ac59-9ed8af106fc3" released by "_copy_volume_from_snapshot" :: held 8.155s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-193f605b-400a-4a5e-95b2-9f590099d3ec-8701db33-af09-4333-ac59-9ed8af106fc3" released by "_create_volume_from_snapshot" :: held 8.196s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.221s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.598s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e2d3e9-0111-473e-aa94-5138e57950bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8701db33-af09-4333-ac59-9ed8af106fc3', 'volume_size': 1, 'snapshot_id': '193f605b-400a-4a5e-95b2-9f590099d3ec'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3346a58e-edbf-47ed-8fed-4e559f1ee566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] Creating offline snapshot 9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 of volume e03c97e0-b2c5-4196-98db-754387bff6c1 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:08:50 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Volume volume-8701db33-af09-4333-ac59-9ed8af106fc3 (8701db33-af09-4333-ac59-9ed8af106fc3): created successfully Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3346a58e-edbf-47ed-8fed-4e559f1ee566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Flow 'volume_create_manager' (80c27c8c-6258-4959-ac21-a606f97bbb01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5830af-c7d5-4b33-a45b-eba213e5e7fb]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:50 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-952643d5-0f12-49d3-90c4-6b6b936563e0 tempest-VolumesDeleteCascade-1268133307 None] Created volume successfully. Apr 24 17:08:50 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 Apr 24 17:08:50 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-722b17e0-1df8-42d9-91bd-74089c8e3a3e-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-722b17e0-1df8-42d9-91bd-74089c8e3a3e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Performing cascade delete. {{(pid=81986) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-193f605b-400a-4a5e-95b2-9f590099d3ec-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-193f605b-400a-4a5e-95b2-9f590099d3ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-quobyte-722b17e0-1df8-42d9-91bd-74089c8e3a3e" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-722b17e0-1df8-42d9-91bd-74089c8e3a3e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-quobyte-193f605b-400a-4a5e-95b2-9f590099d3ec" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-193f605b-400a-4a5e-95b2-9f590099d3ec" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Deleting offline snapshot 193f605b-400a-4a5e-95b2-9f590099d3ec of volume 722b17e0-1df8-42d9-91bd-74089c8e3a3e {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] snapshot_file for this snap is: volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e90c8d-a501-451c-9fad-9fd1aa371c41]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:51 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1" returned: 0 in 0.746s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:51 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 1G Apr 24 17:08:51 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:51 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec Apr 24 17:08:51 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:52 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec" returned: 0 in 0.667s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:08:52 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca8c59c-21bc-449d-aa72-6c95a7fdfeb5]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:52 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 1G" returned: 0 in 0.694s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03c97e0-b2c5-4196-98db-754387bff6c1 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:52 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03c97e0-b2c5-4196-98db-754387bff6c1 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 Apr 24 17:08:52 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:52 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e Apr 24 17:08:52 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:52 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:52 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03c97e0-b2c5-4196-98db-754387bff6c1 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4" returned: 0 in 0.606s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:52 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 is being set with open permissions: ugo+rw Apr 24 17:08:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e" returned: 0 in 0.650s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:52 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 Apr 24 17:08:52 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:52 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec Apr 24 17:08:52 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:53 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4" returned: 0 in 0.536s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:53 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.info Apr 24 17:08:53 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:53 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec" returned: 0 in 0.635s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:53 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec Apr 24 17:08:53 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:53 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.info" returned: 0 in 0.518s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:53 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.info is being set with open permissions: ugo+rw Apr 24 17:08:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:53 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.info Apr 24 17:08:53 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:53 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e.193f605b-400a-4a5e-95b2-9f590099d3ec" returned: 0 in 0.528s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-193f605b-400a-4a5e-95b2-9f590099d3ec" released by "_delete_snapshot" :: held 2.610s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-722b17e0-1df8-42d9-91bd-74089c8e3a3e" released by "delete_snapshot" :: held 2.640s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Created reservations ['a138275a-eada-480a-9491-e2eb3c947c86', '6e0d6c03-aed7-4042-a1d3-6b49b4a80e87', '5743ec12-6e5b-444d-b78a-ed318fbe01ef', '09addf5c-6112-43ac-9bf0-80d3c9c10ec1'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:54 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Delete snapshot completed successfully. Apr 24 17:08:54 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-464d40bb-5f6f-4e8e-8849-c3782d3f5ea1 tempest-GroupSnapshotsV319Test-1864836045 None] Group tempest-GroupSnapshotsV319Test-Group-983366641: creating Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-193f605b-400a-4a5e-95b2-9f590099d3ec-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Snapshots deleted, issuing volume delete {{(pid=81986) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-quobyte-722b17e0-1df8-42d9-91bd-74089c8e3a3e" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-722b17e0-1df8-42d9-91bd-74089c8e3a3e" acquired by "delete_volume" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:54 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-464d40bb-5f6f-4e8e-8849-c3782d3f5ea1 tempest-GroupSnapshotsV319Test-1864836045 None] Group tempest-GroupSnapshotsV319Test-Group-983366641: created successfully Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[772f8ad0-78bc-4cd4-85b3-cc2686f472c7]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:54 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-464d40bb-5f6f-4e8e-8849-c3782d3f5ea1 tempest-GroupSnapshotsV319Test-1864836045 None] Create group completed successfully. Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:54 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e Apr 24 17:08:54 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:54 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.info" returned: 0 in 0.556s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.810s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.568s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d415ea9-1926-4653-b6ef-be5c8294f51c,created_at=2026-04-24T15:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1529840134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d415ea9-1926-4653-b6ef-be5c8294f51c,host='devstack@QuobyteHD#QuobyteHD',id=d433c845-9b04-4323-9659-768f60aa5384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43fc6fdf394f019f04743b4f93082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:44Z,use_quota=True,user_id='d1cbbdbdf5774789a49cd6a0561f9754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cc71b23-b137-4012-bffb-0dde64520e11),volume_type_id=7cc71b23-b137-4012-bffb-0dde64520e11)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Creating volume d433c845-9b04-4323-9659-768f60aa5384 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:54 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:54 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 1073741824 Apr 24 17:08:54 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:54 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-6b5df535-76ef-4d81-bcf6-3a4ed5250adb tempest-SnapshotMetadataTestJSON-841669444 None] Create snapshot completed successfully Apr 24 17:08:54 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e" returned: 0 in 0.597s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:54 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e Apr 24 17:08:54 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:55 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 1073741824" returned: 0 in 0.751s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:55 devstack sudo[86573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 Apr 24 17:08:55 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Acquiring lock "cinder-9d17083b-bf19-4c2d-9b8e-82a18b5be6c4-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Lock "cinder-9d17083b-bf19-4c2d-9b8e-82a18b5be6c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Acquiring lock "cinder-quobyte-e03c97e0-b2c5-4196-98db-754387bff6c1" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:55 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-722b17e0-1df8-42d9-91bd-74089c8e3a3e" returned: 0 in 0.599s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Lock "cinder-quobyte-e03c97e0-b2c5-4196-98db-754387bff6c1" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Acquiring lock "cinder-quobyte-9d17083b-bf19-4c2d-9b8e-82a18b5be6c4" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-722b17e0-1df8-42d9-91bd-74089c8e3a3e" released by "delete_volume" :: held 1.268s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Lock "cinder-quobyte-9d17083b-bf19-4c2d-9b8e-82a18b5be6c4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Deleting offline snapshot 9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 of volume e03c97e0-b2c5-4196-98db-754387bff6c1 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] snapshot_file for this snap is: volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c46e59d-c9f7-45c8-8a8b-a295d2ef6b9e]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Created reservations ['0f3d3edd-0a54-4d10-9120-3686b070454e', '0ca1bac4-8f7a-450a-8b78-6e431af288a0', '439af68e-c9ec-47a8-8397-e126a8df2221', '4fde9964-8132-4e9d-903c-1298a1156c39'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:55 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 Apr 24 17:08:55 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:55 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:55 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Flow 'volume_create_manager' (1316737f-3006-4fff-8a4d-ec56b284aa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2114e6-aeb9-4d7c-92a0-075ff24161fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2114e6-aeb9-4d7c-92a0-075ff24161fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330106765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be917e4e-a05a-44db-90e8-2e17b67db282,host='devstack@QuobyteHD#QuobyteHD',id=c10922bf-553e-41db-8034-f6d1f364357a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b23a88aa24031963aa88afa9035a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:56Z,use_quota=True,user_id='447a2a5da6ed4881a5830fd7f88251b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbc9bb41-868d-4f2e-a0be-bc2514ff8781),volume_type_id=fbc9bb41-868d-4f2e-a0be-bc2514ff8781)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc676fc6-955b-4ea3-a2b7-1cbf6e818ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc676fc6-955b-4ea3-a2b7-1cbf6e818ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f91aae2-2636-4608-b555-6acc6af7e6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f91aae2-2636-4608-b555-6acc6af7e6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c10922bf-553e-41db-8034-f6d1f364357a', 'volume_name': 'volume-c10922bf-553e-41db-8034-f6d1f364357a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13391f3-b0fd-4c0a-bb2b-effffc9abc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13391f3-b0fd-4c0a-bb2b-effffc9abc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b33676-ca3c-422e-9124-ea332ed410f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:55 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Volume c10922bf-553e-41db-8034-f6d1f364357a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c10922bf-553e-41db-8034-f6d1f364357a', 'volume_size': 1} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:55 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384" returned: 0 in 0.681s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.053s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be917e4e-a05a-44db-90e8-2e17b67db282,created_at=2026-04-24T15:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330106765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be917e4e-a05a-44db-90e8-2e17b67db282,host='devstack@QuobyteHD#QuobyteHD',id=c10922bf-553e-41db-8034-f6d1f364357a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b23a88aa24031963aa88afa9035a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:56Z,use_quota=True,user_id='447a2a5da6ed4881a5830fd7f88251b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbc9bb41-868d-4f2e-a0be-bc2514ff8781),volume_type_id=fbc9bb41-868d-4f2e-a0be-bc2514ff8781)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Creating volume c10922bf-553e-41db-8034-f6d1f364357a {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:55 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:08:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:56 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a 1073741824 Apr 24 17:08:56 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901df8c5-b5f3-455b-b931-4cde63c60489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d433c845-9b04-4323-9659-768f60aa5384', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89506cf9-5757-4b64-b8f4-5642eddf36a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:56 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Volume volume-d433c845-9b04-4323-9659-768f60aa5384 (d433c845-9b04-4323-9659-768f60aa5384): created successfully Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89506cf9-5757-4b64-b8f4-5642eddf36a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Flow 'volume_create_manager' (c9650e89-cfef-4268-b6f7-e9f9af167f19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:56 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-4a145ce2-83c6-4ae3-9aaa-47b3a1cbec33 tempest-GroupSnapshotsTest-134446929 None] Created volume successfully. Apr 24 17:08:56 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4" returned: 0 in 0.667s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e03c97e0-b2c5-4196-98db-754387bff6c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[0606e5d6-6512-43a9-b121-801f5fb2cb15]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:56 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.609s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:56 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Deleted volume successfully. Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d57aebff-4e4c-4f58-ae4c-7d78f307e2f6 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-722b17e0-1df8-42d9-91bd-74089c8e3a3e-delete_volume" released by "delete_volume" :: held 5.087s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:56 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 Apr 24 17:08:56 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Flow 'volume_create_manager' (785a8a8e-1a36-4ff1-9fe1-409b750dbd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591f98c3-4a48-4058-b27e-6cbdc5493f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591f98c3-4a48-4058-b27e-6cbdc5493f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-193410331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d415ea9-1926-4653-b6ef-be5c8294f51c,host='devstack@QuobyteHD#QuobyteHD',id=2fb463ec-066c-42e2-a476-6e93ae60e89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43fc6fdf394f019f04743b4f93082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:57Z,use_quota=True,user_id='d1cbbdbdf5774789a49cd6a0561f9754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cc71b23-b137-4012-bffb-0dde64520e11),volume_type_id=7cc71b23-b137-4012-bffb-0dde64520e11)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7455bd-2e58-4e8f-9d61-05d50abd0679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7455bd-2e58-4e8f-9d61-05d50abd0679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb371377-c31a-4e5f-b282-274116dbc179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb371377-c31a-4e5f-b282-274116dbc179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb463ec-066c-42e2-a476-6e93ae60e89d', 'volume_name': 'volume-2fb463ec-066c-42e2-a476-6e93ae60e89d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6039e5-0f8b-4d66-8d6d-44063ceab0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6039e5-0f8b-4d66-8d6d-44063ceab0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c96af4f-08fe-412c-8843-06748528bda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:56 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Volume 2fb463ec-066c-42e2-a476-6e93ae60e89d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb463ec-066c-42e2-a476-6e93ae60e89d', 'volume_size': 1} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-8701db33-af09-4333-ac59-9ed8af106fc3-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-8701db33-af09-4333-ac59-9ed8af106fc3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:56 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a 1073741824" returned: 0 in 0.955s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:56 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "cinder-quobyte-8701db33-af09-4333-ac59-9ed8af106fc3" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1" returned: 0 in 0.747s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:57 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a Apr 24 17:08:57 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-8701db33-af09-4333-ac59-9ed8af106fc3" acquired by "delete_volume" :: waited 0.046s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:57 devstack sudo[86595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 Apr 24 17:08:57 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[0499d3d5-9a95-40a9-8eac-776c7ba1b449]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:57 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3 Apr 24 17:08:57 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:57 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a" returned: 0 in 0.566s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d415ea9-1926-4653-b6ef-be5c8294f51c,created_at=2026-04-24T15:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-193410331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d415ea9-1926-4653-b6ef-be5c8294f51c,host='devstack@QuobyteHD#QuobyteHD',id=2fb463ec-066c-42e2-a476-6e93ae60e89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43fc6fdf394f019f04743b4f93082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:08:57Z,use_quota=True,user_id='d1cbbdbdf5774789a49cd6a0561f9754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cc71b23-b137-4012-bffb-0dde64520e11),volume_type_id=7cc71b23-b137-4012-bffb-0dde64520e11)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Creating volume 2fb463ec-066c-42e2-a476-6e93ae60e89d {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:08:57 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:57 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3" returned: 0 in 0.555s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:57 devstack sudo[86641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d 1073741824 Apr 24 17:08:57 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:57 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4" returned: 0 in 0.627s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:57 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3 Apr 24 17:08:57 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:57 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4 Apr 24 17:08:57 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b33676-ca3c-422e-9124-ea332ed410f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c10922bf-553e-41db-8034-f6d1f364357a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8345dce1-0c28-46c7-b8df-3f163bc3fe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:57 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Volume volume-c10922bf-553e-41db-8034-f6d1f364357a (c10922bf-553e-41db-8034-f6d1f364357a): created successfully Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8345dce1-0c28-46c7-b8df-3f163bc3fe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Flow 'volume_create_manager' (1316737f-3006-4fff-8a4d-ec56b284aa03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:57 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e9a667b0-b6fc-4594-92fe-25e599b6823b tempest-GroupSnapshotsV319Test-1864836045 None] Created volume successfully. Apr 24 17:08:58 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1.9d17083b-bf19-4c2d-9b8e-82a18b5be6c4" returned: 0 in 0.525s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:58 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8701db33-af09-4333-ac59-9ed8af106fc3" returned: 0 in 0.597s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Lock "cinder-quobyte-9d17083b-bf19-4c2d-9b8e-82a18b5be6c4" released by "_delete_snapshot" :: held 2.736s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Lock "cinder-quobyte-e03c97e0-b2c5-4196-98db-754387bff6c1" released by "delete_snapshot" :: held 2.777s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-quobyte-8701db33-af09-4333-ac59-9ed8af106fc3" released by "delete_volume" :: held 1.215s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:58 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] GroupSnapshot 052d2949-95a6-41a2-88e6-7112537eb6bb: creating. Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Created reservations ['3c03ed60-ff47-4083-9da0-76294403c7a6', 'ac47b084-bfc3-40b3-9df0-c36475dd34dd', '21cea3ea-7bbd-470b-a042-4df5a7ba6d84', '01ebeb2f-0c51-4aa1-906e-9c18b708dcbb'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] Group snapshot 052d2949-95a6-41a2-88e6-7112537eb6bb: creating. {{(pid=81986) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Created reservations ['4c496f11-779a-4e9c-b16a-ef8421bbe6b1', 'f02a0185-7f42-4b7b-a42c-5cded699a21f', '5677613b-7159-401d-8412-051df1888650', '9ad11a06-30d8-4ceb-ae7d-3eb38d2b3c82'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:58 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d 1073741824" returned: 0 in 0.797s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:58 devstack sudo[86653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d Apr 24 17:08:58 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:58 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Delete snapshot completed successfully. Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d13842ec-d131-4dd5-87ad-d6b2eeb9e29b tempest-SnapshotMetadataTestJSON-841669444 None] Lock "cinder-9d17083b-bf19-4c2d-9b8e-82a18b5be6c4-delete_snapshot" released by "delete_snapshot" :: held 3.079s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:58 devstack sudo[86655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:08:58 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Acquiring lock "cinder-e03c97e0-b2c5-4196-98db-754387bff6c1-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Lock "cinder-e03c97e0-b2c5-4196-98db-754387bff6c1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Acquiring lock "cinder-quobyte-e03c97e0-b2c5-4196-98db-754387bff6c1" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Lock "cinder-quobyte-e03c97e0-b2c5-4196-98db-754387bff6c1" acquired by "delete_volume" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bba95a-715b-4e16-8afc-ac895a079638]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:58 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 Apr 24 17:08:58 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:59 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.543s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:08:59 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:59 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Deleted volume successfully. Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d" returned: 0 in 0.619s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.676s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d2e560ba-d59e-476d-a372-dc1c30d52848 tempest-VolumesDeleteCascade-1268133307 None] Lock "cinder-8701db33-af09-4333-ac59-9ed8af106fc3-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c96af4f-08fe-412c-8843-06748528bda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb463ec-066c-42e2-a476-6e93ae60e89d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b11cd7-edf7-45b1-9502-43bc08db4b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] Creating offline snapshot 3e602a40-06c9-486f-a84e-45b9f613d466 of volume c10922bf-553e-41db-8034-f6d1f364357a {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:08:59 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Volume volume-2fb463ec-066c-42e2-a476-6e93ae60e89d (2fb463ec-066c-42e2-a476-6e93ae60e89d): created successfully Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b11cd7-edf7-45b1-9502-43bc08db4b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Flow 'volume_create_manager' (785a8a8e-1a36-4ff1-9fe1-409b750dbd81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a45827-0437-48d5-b04d-f57c1e906b2a]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:59 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-4a4086e1-bc87-43a8-9652-f8aba76e5aba tempest-GroupSnapshotsTest-134446929 None] Created volume successfully. Apr 24 17:08:59 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a Apr 24 17:08:59 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:59 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1" returned: 0 in 0.586s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:59 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1 Apr 24 17:08:59 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:59 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a" returned: 0 in 0.640s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:08:59 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 1G Apr 24 17:08:59 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:08:59 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e03c97e0-b2c5-4196-98db-754387bff6c1" returned: 0 in 0.555s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:08:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Lock "cinder-quobyte-e03c97e0-b2c5-4196-98db-754387bff6c1" released by "delete_volume" :: held 1.206s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Created reservations ['bdbec9fc-1f10-4bf8-a95f-029e9aa867ae', '16374f66-01f3-4a2c-9495-86782cbd9042', 'f41473a9-84ad-422f-8a5e-560f26a7e69a', '58823ebd-2282-4c55-bb54-2de08d13b68b'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:00 devstack sudo[86675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:00 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:00 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-c7125d54-f0ca-4aee-9da2-f796c0f794ff tempest-GroupSnapshotsTest-134446929 None] Update group completed successfully. Apr 24 17:09:00 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 1G" returned: 0 in 0.740s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c10922bf-553e-41db-8034-f6d1f364357a -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:00 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c10922bf-553e-41db-8034-f6d1f364357a -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 Apr 24 17:09:00 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:00 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.605s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:00 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Deleted volume successfully. Apr 24 17:09:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0dce76ea-a68f-437b-99e5-e215d22b9503 tempest-SnapshotMetadataTestJSON-841669444 None] Lock "cinder-e03c97e0-b2c5-4196-98db-754387bff6c1-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:01 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c10922bf-553e-41db-8034-f6d1f364357a -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466" returned: 0 in 0.565s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:01 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:09:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:01 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 Apr 24 17:09:01 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:01 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-64fd656c-5e34-4e48-a755-2bf7ab634a32 tempest-GroupSnapshotsTest-134446929 None] Update group completed successfully. Apr 24 17:09:01 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466" returned: 0 in 0.590s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:01 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.info Apr 24 17:09:01 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:02 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.info" returned: 0 in 0.521s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:02 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:09:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:02 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.info Apr 24 17:09:02 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:02 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-374cf82f-939a-4e12-b737-8892c3696422 tempest-GroupSnapshotsTest-134446929 None] Update group completed successfully. Apr 24 17:09:02 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.info" returned: 0 in 0.553s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.745s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:02 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d93f6f20-3c81-442f-b280-db4717e4145a tempest-GroupSnapshotsV319Test-1864836045 None] group_snapshot 052d2949-95a6-41a2-88e6-7112537eb6bb: created successfully Apr 24 17:09:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:09:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:02 devstack sudo[86695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:02 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:03 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.578s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Flow 'volume_create_manager' (cb030c00-ff6d-4477-832c-8f1cab07b869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9aecfe-3f22-4792-87a1-0f79e4bcfaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9aecfe-3f22-4792-87a1-0f79e4bcfaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-393307235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a84bd43-bf30-493c-bab7-b9408d5ae766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c27d802491465385bc328c033257ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:04Z,use_quota=True,user_id='9d7335b71461463dbd1dd01d5fe247d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf4b2aa-3849-4e2b-8297-09ecbb86a52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf4b2aa-3849-4e2b-8297-09ecbb86a52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448d771e-c964-4924-beb9-8bddc5ed9279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448d771e-c964-4924-beb9-8bddc5ed9279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a84bd43-bf30-493c-bab7-b9408d5ae766', 'volume_name': 'volume-3a84bd43-bf30-493c-bab7-b9408d5ae766', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126cddbc-03cc-4b2f-9e4c-0beda7095766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126cddbc-03cc-4b2f-9e4c-0beda7095766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e580a8ff-90a4-4142-b0e9-411650d0bac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:03 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Volume 3a84bd43-bf30-493c-bab7-b9408d5ae766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a84bd43-bf30-493c-bab7-b9408d5ae766', 'volume_size': 1} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-393307235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a84bd43-bf30-493c-bab7-b9408d5ae766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c27d802491465385bc328c033257ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:04Z,use_quota=True,user_id='9d7335b71461463dbd1dd01d5fe247d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Creating volume 3a84bd43-bf30-493c-bab7-b9408d5ae766 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:03 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:03 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766 1073741824 Apr 24 17:09:03 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:03 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-68ce04b1-cc25-4536-9096-2a9de5de9d86 tempest-GroupSnapshotsTest-134446929 None] Update group completed successfully. Apr 24 17:09:04 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] group_snapshot 052d2949-95a6-41a2-88e6-7112537eb6bb: deleting Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] group_snapshot 052d2949-95a6-41a2-88e6-7112537eb6bb: deleting {{(pid=81986) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Acquiring lock "cinder-quobyte-c10922bf-553e-41db-8034-f6d1f364357a" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Lock "cinder-quobyte-c10922bf-553e-41db-8034-f6d1f364357a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Acquiring lock "cinder-quobyte-3e602a40-06c9-486f-a84e-45b9f613d466" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Lock "cinder-quobyte-3e602a40-06c9-486f-a84e-45b9f613d466" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Deleting offline snapshot 3e602a40-06c9-486f-a84e-45b9f613d466 of volume c10922bf-553e-41db-8034-f6d1f364357a {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] snapshot_file for this snap is: volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dcf444-bf10-4e49-8e26-ca735a8fa382]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:04 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 Apr 24 17:09:04 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:04 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766 1073741824" returned: 0 in 0.830s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:04 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466" returned: 0 in 0.597s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c10922bf-553e-41db-8034-f6d1f364357a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:09:04 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766 Apr 24 17:09:04 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da14866-5f43-4803-94e2-81f22add0264]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:04 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a Apr 24 17:09:04 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:05 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] GroupSnapshot 986db79b-9a1d-44d2-bfe2-b0d915d0c80d: creating. Apr 24 17:09:05 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766" returned: 0 in 0.541s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e580a8ff-90a4-4142-b0e9-411650d0bac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a84bd43-bf30-493c-bab7-b9408d5ae766', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54006d2-54e9-4282-8774-6741bec22669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Group snapshot 986db79b-9a1d-44d2-bfe2-b0d915d0c80d: creating. {{(pid=81986) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 17:09:05 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Volume volume-3a84bd43-bf30-493c-bab7-b9408d5ae766 (3a84bd43-bf30-493c-bab7-b9408d5ae766): created successfully Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54006d2-54e9-4282-8774-6741bec22669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Flow 'volume_create_manager' (cb030c00-ff6d-4477-832c-8f1cab07b869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:05 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a203bd26-e54f-4a36-bbb7-e76aa6dcfbbc tempest-VolumesTransfersV355Test-1220740945 None] Created volume successfully. Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Creating offline snapshot 39767571-0bf7-4788-83ac-49d4c1db1373 of volume d433c845-9b04-4323-9659-768f60aa5384 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6238713-eaea-4554-91ba-e0fa796f2049]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:05 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 Apr 24 17:09:05 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:05 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a" returned: 0 in 0.755s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:05 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 Apr 24 17:09:05 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:06 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384" returned: 0 in 0.655s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:06 devstack sudo[86726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 1G Apr 24 17:09:06 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:06 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466" returned: 0 in 0.675s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:06 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466 Apr 24 17:09:06 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:06 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-231519ce-0fd4-4169-b7e4-e96ed9e47bd6 tempest-VolumesTransfersV355Test-1559124429 None] Transfer volume completed successfully. Apr 24 17:09:06 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a.3e602a40-06c9-486f-a84e-45b9f613d466" returned: 0 in 0.560s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Lock "cinder-quobyte-3e602a40-06c9-486f-a84e-45b9f613d466" released by "_delete_snapshot" :: held 2.734s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Lock "cinder-quobyte-c10922bf-553e-41db-8034-f6d1f364357a" released by "delete_snapshot" :: held 2.765s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:06 devstack cinder-volume[81986]: WARNING cinder.quota [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-325696448 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-325696448, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:06 devstack cinder-volume[81986]: WARNING cinder.quota [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-325696448 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-325696448, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:06 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 1G" returned: 0 in 0.842s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d433c845-9b04-4323-9659-768f60aa5384 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:07 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d433c845-9b04-4323-9659-768f60aa5384 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 Apr 24 17:09:07 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:07 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] Created reservations ['5530c72c-c81b-4da9-a13a-3ab68059cbce', '866be935-56d0-4867-ab3f-3e2938156a3c', '3d44385b-af54-4aa5-90c3-23def5a80b34', 'e0576aaa-5b6b-4a8d-a2c9-d78f246f7794'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:07 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-fe9c0aea-df09-4c43-83c1-5a070eaffc64 tempest-GroupSnapshotsV319Test-1864836045 None] group_snapshot 052d2949-95a6-41a2-88e6-7112537eb6bb: deleted successfully Apr 24 17:09:07 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d433c845-9b04-4323-9659-768f60aa5384 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373" returned: 0 in 0.532s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:07 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:09:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:07 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 Apr 24 17:09:07 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Acquiring lock "cinder-quobyte-c10922bf-553e-41db-8034-f6d1f364357a" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Lock "cinder-quobyte-c10922bf-553e-41db-8034-f6d1f364357a" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:07 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8f616-fd9c-4a82-a25f-f2ab8a6f4836]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:07 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Flow 'volume_create_manager' (e2fda199-5033-4f0e-9929-dd7f3354acd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc489d29-1d13-4e49-9aa8-c0a67e0652ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:08 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a Apr 24 17:09:08 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Acquiring lock "cinder-3a84bd43-bf30-493c-bab7-b9408d5ae766-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc489d29-1d13-4e49-9aa8-c0a67e0652ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1623665626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28577658-dfbd-4ce3-9c31-8d9ea5994a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466b2117610e45088fc417c46f25cdd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:08Z,use_quota=True,user_id='79502d511471461f801bbcf60ae48c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b33814-50d8-4ff9-aa00-f3213d7b2ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b33814-50d8-4ff9-aa00-f3213d7b2ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64f1939-2948-4b58-bd94-6a717448d13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:08 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64f1939-2948-4b58-bd94-6a717448d13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28577658-dfbd-4ce3-9c31-8d9ea5994a28', 'volume_name': 'volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9372cc0a-66dc-4769-9262-7be1e38ec6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9372cc0a-66dc-4769-9262-7be1e38ec6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5407b291-7d84-4c18-a849-03e7c4df2e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:08 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Volume 28577658-dfbd-4ce3-9c31-8d9ea5994a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28', 'volume_size': 1} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373" returned: 0 in 0.614s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Lock "cinder-3a84bd43-bf30-493c-bab7-b9408d5ae766-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:08 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.info Apr 24 17:09:08 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Acquiring lock "cinder-quobyte-3a84bd43-bf30-493c-bab7-b9408d5ae766" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Lock "cinder-quobyte-3a84bd43-bf30-493c-bab7-b9408d5ae766" acquired by "delete_volume" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[500f5890-c36e-4065-b322-1c405500e1f9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:08 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766 Apr 24 17:09:08 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:08 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a" returned: 0 in 0.551s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:08 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a Apr 24 17:09:08 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:08 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.info" returned: 0 in 0.502s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:08 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:08 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.info Apr 24 17:09:08 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:08 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766" returned: 0 in 0.557s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:08 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766 Apr 24 17:09:08 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:08 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c10922bf-553e-41db-8034-f6d1f364357a" returned: 0 in 0.443s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Lock "cinder-quobyte-c10922bf-553e-41db-8034-f6d1f364357a" released by "delete_volume" :: held 1.061s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Created reservations ['021bfe34-bdf1-43aa-9e1d-acc5f9280e84'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:09 devstack cinder-volume[81986]: WARNING cinder.quota [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-325696448 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-325696448, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Created reservations ['c5c009c5-a575-4585-93c0-4aea83b82295', '644790bf-b52f-46c7-96eb-2042741992b1', 'd0da64e5-9e12-4529-bb83-3ae9a0c899c1', '2b0bb64b-e9f3-41ad-a92c-21a659a14379'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:09 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:09 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:09 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.info" returned: 0 in 0.530s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.803s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Creating offline snapshot e74379a1-5ecc-4609-85a4-db81ec6e2a6a of volume 2fb463ec-066c-42e2-a476-6e93ae60e89d {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0006ff1-3c27-4663-bd07-200883c1823b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:09 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3a84bd43-bf30-493c-bab7-b9408d5ae766" returned: 0 in 0.514s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Lock "cinder-quobyte-3a84bd43-bf30-493c-bab7-b9408d5ae766" released by "delete_volume" :: held 1.109s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:09 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d Apr 24 17:09:09 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Created reservations ['8fcbad7f-1a95-4498-80a1-a7094bdefe40', 'aaabb20c-45a1-4710-9f3f-4b263418919b', '193d6002-4e95-4fdf-b4ae-c96cdf744a03', '47553f51-bd31-4d2d-9329-200b881ac0d0'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:09 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:09 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:09 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.491s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:09 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d275ef57-8441-44b1-bad6-53a387db97d6 tempest-GroupSnapshotsV319Test-1864836045 None] Delete group completed successfully. Apr 24 17:09:09 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d" returned: 0 in 0.535s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:09 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a 1G Apr 24 17:09:09 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:09 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.474s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:09 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:09 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Deleted volume successfully. Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0abec973-5346-426b-b753-585a0b3ecea1 tempest-VolumesTransfersV355Test-1067958427 None] Lock "cinder-3a84bd43-bf30-493c-bab7-b9408d5ae766-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:10 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a 1G" returned: 0 in 0.727s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb463ec-066c-42e2-a476-6e93ae60e89d -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:10 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb463ec-066c-42e2-a476-6e93ae60e89d -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a Apr 24 17:09:10 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Flow 'volume_create_manager' (1629cf2a-aec2-43e3-bcdf-7e944ba68f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d2f724-c2a3-473b-b254-1e4a8edb235f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d2f724-c2a3-473b-b254-1e4a8edb235f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-850207390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a525b5ad-0592-4dfe-abfb-165eb0a1dbec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c27d802491465385bc328c033257ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:11Z,use_quota=True,user_id='9d7335b71461463dbd1dd01d5fe247d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345df6ee-9b9b-42e8-b12d-1ddf3302d686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345df6ee-9b9b-42e8-b12d-1ddf3302d686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93ad89b-96e5-4cc4-8bb7-204a3beef38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93ad89b-96e5-4cc4-8bb7-204a3beef38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a525b5ad-0592-4dfe-abfb-165eb0a1dbec', 'volume_name': 'volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950e169a-d484-462d-8e97-58c01d661d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950e169a-d484-462d-8e97-58c01d661d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab35a834-f0e9-428f-ba6b-6b8d5259a148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:10 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Volume a525b5ad-0592-4dfe-abfb-165eb0a1dbec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec', 'volume_size': 1} Apr 24 17:09:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:11 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb463ec-066c-42e2-a476-6e93ae60e89d -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a" returned: 0 in 0.640s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:11 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:09:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:11 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a Apr 24 17:09:11 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:11 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a" returned: 0 in 0.501s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:11 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.info Apr 24 17:09:11 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:12 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.info" returned: 0 in 0.547s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:12 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:12 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.info Apr 24 17:09:12 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:12 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.info" returned: 0 in 0.552s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.586s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.717s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1623665626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28577658-dfbd-4ce3-9c31-8d9ea5994a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466b2117610e45088fc417c46f25cdd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:08Z,use_quota=True,user_id='79502d511471461f801bbcf60ae48c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Creating volume 28577658-dfbd-4ce3-9c31-8d9ea5994a28 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:12 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:12 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28 1073741824 Apr 24 17:09:12 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:12 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-66e02357-2477-4854-ab5a-fdc4a88cfeba tempest-GroupSnapshotsTest-134446929 None] group_snapshot 986db79b-9a1d-44d2-bfe2-b0d915d0c80d: created successfully Apr 24 17:09:13 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28 1073741824" returned: 0 in 0.701s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:13 devstack sudo[86800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28 Apr 24 17:09:13 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:13 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] group_snapshot 986db79b-9a1d-44d2-bfe2-b0d915d0c80d: deleting Apr 24 17:09:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] group_snapshot 986db79b-9a1d-44d2-bfe2-b0d915d0c80d: deleting {{(pid=81986) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 17:09:13 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-d433c845-9b04-4323-9659-768f60aa5384" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-d433c845-9b04-4323-9659-768f60aa5384" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-39767571-0bf7-4788-83ac-49d4c1db1373" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-39767571-0bf7-4788-83ac-49d4c1db1373" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Deleting offline snapshot 39767571-0bf7-4788-83ac-49d4c1db1373 of volume d433c845-9b04-4323-9659-768f60aa5384 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] snapshot_file for this snap is: volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bb2231-65ed-4fd3-aa35-22bd6cb92ce8]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:14 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28" returned: 0 in 0.595s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.348s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-850207390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a525b5ad-0592-4dfe-abfb-165eb0a1dbec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c27d802491465385bc328c033257ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:11Z,use_quota=True,user_id='9d7335b71461463dbd1dd01d5fe247d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Creating volume a525b5ad-0592-4dfe-abfb-165eb0a1dbec {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:14 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 Apr 24 17:09:14 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:14 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5407b291-7d84-4c18-a849-03e7c4df2e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:14 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec 1073741824 Apr 24 17:09:14 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e977dfd4-41b5-477d-a6b9-82b3a4c075b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:14 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Volume volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28 (28577658-dfbd-4ce3-9c31-8d9ea5994a28): created successfully Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e977dfd4-41b5-477d-a6b9-82b3a4c075b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Flow 'volume_create_manager' (e2fda199-5033-4f0e-9929-dd7f3354acd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:14 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-c903683f-c2a4-414d-9564-e4315063199f tempest-VolumesTransfersTest-1513336727 None] Created volume successfully. Apr 24 17:09:14 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373" returned: 0 in 0.721s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d433c845-9b04-4323-9659-768f60aa5384(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbb50ff-1c7b-4ae8-a400-09600c1918fd]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:14 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 Apr 24 17:09:14 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:15 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec 1073741824" returned: 0 in 0.879s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:15 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-8c96d056-6cef-430e-9c25-f0f778cee0c9 tempest-VolumesTransfersTest-826379632 None] Transfer volume completed successfully. Apr 24 17:09:15 devstack sudo[86816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec Apr 24 17:09:15 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:15 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384" returned: 0 in 0.613s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:15 devstack sudo[86821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 Apr 24 17:09:15 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:15 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec" returned: 0 in 0.542s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab35a834-f0e9-428f-ba6b-6b8d5259a148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b051335d-1398-4e49-a1b7-1da87ce6445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:15 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Volume volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec (a525b5ad-0592-4dfe-abfb-165eb0a1dbec): created successfully Apr 24 17:09:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b051335d-1398-4e49-a1b7-1da87ce6445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Flow 'volume_create_manager' (1629cf2a-aec2-43e3-bcdf-7e944ba68f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:15 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-7d03203e-c6cc-4e7c-a4ba-76ad08b8e885 tempest-VolumesTransfersV355Test-1220740945 None] Created volume successfully. Apr 24 17:09:16 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373" returned: 0 in 0.736s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:16 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373 Apr 24 17:09:16 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Acquiring lock "cinder-28577658-dfbd-4ce3-9c31-8d9ea5994a28-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Lock "cinder-28577658-dfbd-4ce3-9c31-8d9ea5994a28-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Acquiring lock "cinder-quobyte-28577658-dfbd-4ce3-9c31-8d9ea5994a28" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Lock "cinder-quobyte-28577658-dfbd-4ce3-9c31-8d9ea5994a28" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de2e318-37d3-4d35-9f07-e4a9ab3d275b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Acquiring lock "cinder-a525b5ad-0592-4dfe-abfb-165eb0a1dbec-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Lock "cinder-a525b5ad-0592-4dfe-abfb-165eb0a1dbec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:16 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28 Apr 24 17:09:16 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Acquiring lock "cinder-quobyte-a525b5ad-0592-4dfe-abfb-165eb0a1dbec" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Lock "cinder-quobyte-a525b5ad-0592-4dfe-abfb-165eb0a1dbec" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[88beab35-b955-4512-b340-96d079aa8ade]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:16 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec Apr 24 17:09:16 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:16 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384.39767571-0bf7-4788-83ac-49d4c1db1373" returned: 0 in 0.689s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-39767571-0bf7-4788-83ac-49d4c1db1373" released by "_delete_snapshot" :: held 2.890s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-d433c845-9b04-4323-9659-768f60aa5384" released by "delete_snapshot" :: held 2.917s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-2fb463ec-066c-42e2-a476-6e93ae60e89d" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-2fb463ec-066c-42e2-a476-6e93ae60e89d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-e74379a1-5ecc-4609-85a4-db81ec6e2a6a" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-e74379a1-5ecc-4609-85a4-db81ec6e2a6a" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Deleting offline snapshot e74379a1-5ecc-4609-85a4-db81ec6e2a6a of volume 2fb463ec-066c-42e2-a476-6e93ae60e89d {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] snapshot_file for this snap is: volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5498a4d1-6dfd-4d2b-9f34-e2df585de3f0]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:17 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28" returned: 0 in 0.683s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:17 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a Apr 24 17:09:17 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:17 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28 Apr 24 17:09:17 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:17 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec" returned: 0 in 0.676s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:17 devstack sudo[86844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec Apr 24 17:09:17 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:17 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-28577658-dfbd-4ce3-9c31-8d9ea5994a28" returned: 0 in 0.558s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Lock "cinder-quobyte-28577658-dfbd-4ce3-9c31-8d9ea5994a28" released by "delete_volume" :: held 1.289s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:17 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a" returned: 0 in 0.711s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fb463ec-066c-42e2-a476-6e93ae60e89d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Created reservations ['b8e9bfbe-cb19-4e00-8720-e81e33164dc5', '984ffd7d-1505-428d-957b-972d5ac94a70', '3bc8adb5-4bd7-43aa-bc1d-8b25766974c6', '1b77dcbf-5d1c-45c6-a369-3cd58b858dbd'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b25f43-f0b9-4515-9345-44c00f075ede]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:17 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d Apr 24 17:09:17 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:17 devstack sudo[86853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:17 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:17 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a525b5ad-0592-4dfe-abfb-165eb0a1dbec" returned: 0 in 0.683s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Lock "cinder-quobyte-a525b5ad-0592-4dfe-abfb-165eb0a1dbec" released by "delete_volume" :: held 1.429s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Created reservations ['0b0aebc5-ea88-42cf-bb58-2e701015ad8e', 'ebf5ebb5-8c05-4ffa-815a-74bf40dfef20', '7f17485e-b723-4d67-a7e7-3177ba58e1e1', 'c38672d5-147f-47e7-ad7e-9bdbe75d5ba9'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:18 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:18 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:18 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d" returned: 0 in 0.663s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:18 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a Apr 24 17:09:18 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:18 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.625s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:18 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Deleted volume successfully. Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7158b870-94ba-414c-853c-1a6d77c58513 tempest-VolumesTransfersTest-1571736640 None] Lock "cinder-28577658-dfbd-4ce3-9c31-8d9ea5994a28-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:18 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.603s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:18 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Deleted volume successfully. Apr 24 17:09:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3687c4-8022-4712-b08f-8c826f2961cd tempest-VolumesTransfersV355Test-1067958427 None] Lock "cinder-a525b5ad-0592-4dfe-abfb-165eb0a1dbec-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Flow 'volume_create_manager' (d0c5b376-6eb3-4ec8-bcb0-332813bf862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2cd6a3-aa4d-49d5-9e6a-e360358fc46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2cd6a3-aa4d-49d5-9e6a-e360358fc46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-549650689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488973fe-463c-41ad-b6b2-57ea9db2db65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466b2117610e45088fc417c46f25cdd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:19Z,use_quota=True,user_id='79502d511471461f801bbcf60ae48c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fe114a-f563-45d1-b6e0-8863c8691f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fe114a-f563-45d1-b6e0-8863c8691f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:19 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f9b0c9-d10e-4f06-bc3d-286fd931ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f9b0c9-d10e-4f06-bc3d-286fd931ba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488973fe-463c-41ad-b6b2-57ea9db2db65', 'volume_name': 'volume-488973fe-463c-41ad-b6b2-57ea9db2db65', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152e7e29-4d6e-4c7f-aabc-18af7f67a433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152e7e29-4d6e-4c7f-aabc-18af7f67a433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a6492d-837a-4017-95a4-5e625cfe034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:19 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Volume 488973fe-463c-41ad-b6b2-57ea9db2db65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488973fe-463c-41ad-b6b2-57ea9db2db65', 'volume_size': 1} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-549650689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488973fe-463c-41ad-b6b2-57ea9db2db65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466b2117610e45088fc417c46f25cdd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:19Z,use_quota=True,user_id='79502d511471461f801bbcf60ae48c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Creating volume 488973fe-463c-41ad-b6b2-57ea9db2db65 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:19 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a" returned: 0 in 0.850s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:19 devstack sudo[86868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65 1073741824 Apr 24 17:09:19 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:19 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a Apr 24 17:09:19 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:19 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d.e74379a1-5ecc-4609-85a4-db81ec6e2a6a" returned: 0 in 0.617s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-e74379a1-5ecc-4609-85a4-db81ec6e2a6a" released by "_delete_snapshot" :: held 2.973s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-2fb463ec-066c-42e2-a476-6e93ae60e89d" released by "delete_snapshot" :: held 3.021s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:20 devstack cinder-volume[81986]: WARNING cinder.quota [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-469834205 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-469834205, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:20 devstack cinder-volume[81986]: WARNING cinder.quota [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-469834205 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-469834205, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:20 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65 1073741824" returned: 0 in 0.785s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Created reservations ['31ac9d06-84d8-41e8-9790-c0ea3b377511', '1f6b6dfd-9aea-4f89-8848-303b6739d3ee', '7bc4e1ba-c4bf-4eae-9e77-e705ab8d2ec4', '1ea27596-2adf-4127-b481-b1bd7586a4a9'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:20 devstack sudo[86876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65 Apr 24 17:09:20 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] Created reservations ['6b2ac2b6-7bd1-4369-a385-70ab5e809c49', '63f28cae-68fd-4452-8d77-7701e3f4703e', 'c35570fe-1cba-4c1d-84a8-793da75cbf2f', '8009c1e8-8c46-4bf7-9a04-f962669044fb'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:20 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e9a04ff1-f91c-418d-99ac-5333bc70c624 tempest-GroupSnapshotsTest-134446929 None] group_snapshot 986db79b-9a1d-44d2-bfe2-b0d915d0c80d: deleted successfully Apr 24 17:09:20 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65" returned: 0 in 0.604s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a6492d-837a-4017-95a4-5e625cfe034f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488973fe-463c-41ad-b6b2-57ea9db2db65', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5d9982-6065-4a03-9917-e614bd407c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-2fb463ec-066c-42e2-a476-6e93ae60e89d" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:20 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Volume volume-488973fe-463c-41ad-b6b2-57ea9db2db65 (488973fe-463c-41ad-b6b2-57ea9db2db65): created successfully Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5d9982-6065-4a03-9917-e614bd407c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Flow 'volume_create_manager' (d0c5b376-6eb3-4ec8-bcb0-332813bf862e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:20 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-81de061b-1527-491b-b64a-c509ad005af0 tempest-VolumesTransfersTest-1513336727 None] Created volume successfully. Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-2fb463ec-066c-42e2-a476-6e93ae60e89d" acquired by "delete_volume" :: waited 0.042s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ca0f19-e17f-40b6-b907-ea6208d455cb]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:20 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d Apr 24 17:09:20 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:21 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d" returned: 0 in 0.663s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:21 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d Apr 24 17:09:21 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Acquiring lock "cinder-488973fe-463c-41ad-b6b2-57ea9db2db65-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Lock "cinder-488973fe-463c-41ad-b6b2-57ea9db2db65-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Acquiring lock "cinder-quobyte-488973fe-463c-41ad-b6b2-57ea9db2db65" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Lock "cinder-quobyte-488973fe-463c-41ad-b6b2-57ea9db2db65" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:21 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ede0933-fa9a-4b8d-b352-504bf59cedc3]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:22 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65 Apr 24 17:09:22 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:22 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2fb463ec-066c-42e2-a476-6e93ae60e89d" returned: 0 in 0.627s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-2fb463ec-066c-42e2-a476-6e93ae60e89d" released by "delete_volume" :: held 1.361s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-d433c845-9b04-4323-9659-768f60aa5384" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-d433c845-9b04-4323-9659-768f60aa5384" acquired by "delete_volume" :: waited 0.030s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:22 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b38c125-4b6c-40e1-b299-989ba6e4cc93]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:22 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 Apr 24 17:09:22 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:22 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65" returned: 0 in 0.716s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:22 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65 Apr 24 17:09:22 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:23 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384" returned: 0 in 0.790s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:23 devstack sudo[86899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384 Apr 24 17:09:23 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:23 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-488973fe-463c-41ad-b6b2-57ea9db2db65" returned: 0 in 0.643s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Lock "cinder-quobyte-488973fe-463c-41ad-b6b2-57ea9db2db65" released by "delete_volume" :: held 1.445s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Created reservations ['bf7c67d2-00ca-4dfb-ae2c-fab37d0cff36', '22ea8430-01ee-428f-a144-8dc0b906f928', 'b8d2bf15-6621-4f7a-93e6-568abdad7b44', '9ab90e40-9951-42ab-ab2c-365916be1d14'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:23 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:23 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:23 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d433c845-9b04-4323-9659-768f60aa5384" returned: 0 in 0.550s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-d433c845-9b04-4323-9659-768f60aa5384" released by "delete_volume" :: held 1.425s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Created reservations ['b842c2f1-eddd-4043-b03b-bb38f56f7454'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:23 devstack cinder-volume[81986]: WARNING cinder.quota [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-469834205 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-469834205, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Created reservations ['c3542301-96bc-41fc-a116-a22f278a391f', 'c9c3405a-ec60-4895-8ccf-8bbc86227a65', '249a7f07-6e1b-4990-b3fe-ae19256255ba', 'f5b5ddec-3fc8-4d2e-9c05-27f9c6165d04'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:23 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Created reservations ['2948ea03-288d-4770-b333-995dcfa0cf49', 'ed7b9a97-44a9-4644-b1dc-1fc9d08c7fd9', '82a6ea35-b32b-421a-990e-4765664e7fe5', 'c9166ec8-b95a-416b-9264-d5f9a170ef45'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:24 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.669s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:24 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:24 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Deleted volume successfully. Apr 24 17:09:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a4ea22cb-7a0c-4d07-9337-c777e184e49e tempest-VolumesTransfersTest-1571736640 None] Lock "cinder-488973fe-463c-41ad-b6b2-57ea9db2db65-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:24 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:24 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:24 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.596s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:24 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:24 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-aefeb867-e5b2-4af8-8c3b-a7c83cfecdaa tempest-GroupSnapshotsTest-134446929 None] Delete group completed successfully. Apr 24 17:09:24 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-71297ab9-450d-4af6-8249-0dbd132a7818 tempest-GroupSnapshotsTest-134446929 None] Group tempest-GroupSnapshotsTest-Group-1524818876: creating Apr 24 17:09:24 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-71297ab9-450d-4af6-8249-0dbd132a7818 tempest-GroupSnapshotsTest-134446929 None] Group tempest-GroupSnapshotsTest-Group-1524818876: created successfully Apr 24 17:09:25 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-71297ab9-450d-4af6-8249-0dbd132a7818 tempest-GroupSnapshotsTest-134446929 None] Create group completed successfully. Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Flow 'volume_create_manager' (9d90a6f8-a57c-4853-acc9-0198b7f96c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665454e1-8f57-4fb3-8a1a-1ae7b2cff250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665454e1-8f57-4fb3-8a1a-1ae7b2cff250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-174224235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce2d69c-4271-40be-b1ed-9244ca7dd0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf05967f7de40bfa6b66826aa6e9cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:25Z,use_quota=True,user_id='1e1ebab2c0fe4d91aa6b197dc86eb796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6b5d94-3819-4fd5-b3d8-108ead239b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6b5d94-3819-4fd5-b3d8-108ead239b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200637b6-cac9-4536-a97d-4d31429e1ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200637b6-cac9-4536-a97d-4d31429e1ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce2d69c-4271-40be-b1ed-9244ca7dd0dd', 'volume_name': 'volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd', 'volume_size': 2}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a56c2cf-641a-466a-beed-4a492998e061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a56c2cf-641a-466a-beed-4a492998e061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80bd7d3e-0050-4506-9721-c225dfcb2085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:25 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Volume bce2d69c-4271-40be-b1ed-9244ca7dd0dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd', 'volume_size': 2} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-174224235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce2d69c-4271-40be-b1ed-9244ca7dd0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf05967f7de40bfa6b66826aa6e9cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:25Z,use_quota=True,user_id='1e1ebab2c0fe4d91aa6b197dc86eb796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Creating volume bce2d69c-4271-40be-b1ed-9244ca7dd0dd {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:25 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd 2147483648 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:25 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd 2147483648 Apr 24 17:09:25 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:26 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd 2147483648" returned: 0 in 0.904s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=189,cinder:INSERT=62,cinder:UPDATE=205,cinder:DELETE=16 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Flow 'volume_create_manager' (be151844-7c07-4de9-846b-0a4b2a0160ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df64bcd-5a65-4f30-9194-d7fcd0004745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df64bcd-5a65-4f30-9194-d7fcd0004745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1325096236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e63c2f29-1676-472f-97a1-47e5b51202dd,host='devstack@QuobyteHD#QuobyteHD',id=27a55c79-48b9-415b-a490-3ab2c69f029d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43fc6fdf394f019f04743b4f93082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:26Z,use_quota=True,user_id='d1cbbdbdf5774789a49cd6a0561f9754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e87a0fd-303b-4004-a61c-631683e3f81e),volume_type_id=7e87a0fd-303b-4004-a61c-631683e3f81e)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e798ad0-8d3b-4063-9771-687ff102e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e798ad0-8d3b-4063-9771-687ff102e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ccb779-2e71-4728-964d-755f89fcd1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ccb779-2e71-4728-964d-755f89fcd1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a55c79-48b9-415b-a490-3ab2c69f029d', 'volume_name': 'volume-27a55c79-48b9-415b-a490-3ab2c69f029d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a77ed1-18be-4f83-8764-c0b07551d23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a77ed1-18be-4f83-8764-c0b07551d23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dde6628-b9b2-45fd-86c1-01bffd671cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:26 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Volume 27a55c79-48b9-415b-a490-3ab2c69f029d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a55c79-48b9-415b-a490-3ab2c69f029d', 'volume_size': 1} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:26 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd Apr 24 17:09:26 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:27 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd" returned: 0 in 0.503s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e63c2f29-1676-472f-97a1-47e5b51202dd,created_at=2026-04-24T15:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1325096236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e63c2f29-1676-472f-97a1-47e5b51202dd,host='devstack@QuobyteHD#QuobyteHD',id=27a55c79-48b9-415b-a490-3ab2c69f029d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43fc6fdf394f019f04743b4f93082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:26Z,use_quota=True,user_id='d1cbbdbdf5774789a49cd6a0561f9754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e87a0fd-303b-4004-a61c-631683e3f81e),volume_type_id=7e87a0fd-303b-4004-a61c-631683e3f81e)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Creating volume 27a55c79-48b9-415b-a490-3ab2c69f029d {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:27 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:27 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d 1073741824 Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80bd7d3e-0050-4506-9721-c225dfcb2085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd', 'volume_size': 2}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:27 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb9a894-adbe-47cc-b51f-cff1f3a70f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:27 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Volume volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd (bce2d69c-4271-40be-b1ed-9244ca7dd0dd): created successfully Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb9a894-adbe-47cc-b51f-cff1f3a70f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Flow 'volume_create_manager' (9d90a6f8-a57c-4853-acc9-0198b7f96c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:27 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b54c1c9b-ee47-42e0-8c2f-b1b378a60636 tempest-VolumesCloneNegativeTest-1458251242 None] Created volume successfully. Apr 24 17:09:27 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-20a53d5e-ec99-45dd-9423-bbc9fed2035a tempest-GroupsTest-1198067932 None] Group tempest-Group1-1665012967: creating Apr 24 17:09:27 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-20a53d5e-ec99-45dd-9423-bbc9fed2035a tempest-GroupsTest-1198067932 None] Group tempest-Group1-1665012967: created successfully Apr 24 17:09:27 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-20a53d5e-ec99-45dd-9423-bbc9fed2035a tempest-GroupsTest-1198067932 None] Create group completed successfully. Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Acquiring lock "cinder-bce2d69c-4271-40be-b1ed-9244ca7dd0dd-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Lock "cinder-bce2d69c-4271-40be-b1ed-9244ca7dd0dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Acquiring lock "cinder-quobyte-bce2d69c-4271-40be-b1ed-9244ca7dd0dd" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Lock "cinder-quobyte-bce2d69c-4271-40be-b1ed-9244ca7dd0dd" acquired by "delete_volume" :: waited 0.027s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4114517-ba99-4ba8-a048-f450ba69981c]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:28 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d 1073741824" returned: 0 in 0.881s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:28 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd Apr 24 17:09:28 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:28 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d Apr 24 17:09:28 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:28 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:28 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d" returned: 0 in 0.518s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:28 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd" returned: 0 in 0.640s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:28 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd Apr 24 17:09:28 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:28 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dde6628-b9b2-45fd-86c1-01bffd671cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a55c79-48b9-415b-a490-3ab2c69f029d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:28 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4322d005-6a89-4425-a23b-ac0b63b1d155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:28 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Volume volume-27a55c79-48b9-415b-a490-3ab2c69f029d (27a55c79-48b9-415b-a490-3ab2c69f029d): created successfully Apr 24 17:09:28 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4322d005-6a89-4425-a23b-ac0b63b1d155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:28 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Flow 'volume_create_manager' (be151844-7c07-4de9-846b-0a4b2a0160ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:28 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d0cfd991-2296-43a8-9a89-81104eb3f113 tempest-GroupSnapshotsTest-134446929 None] Created volume successfully. Apr 24 17:09:28 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3d466e98-ea16-4157-98bb-d41e0d5990f0 tempest-GroupsTest-1198067932 None] Group tempest-Group2-1078478008: creating Apr 24 17:09:28 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3d466e98-ea16-4157-98bb-d41e0d5990f0 tempest-GroupsTest-1198067932 None] Group tempest-Group2-1078478008: created successfully Apr 24 17:09:28 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3d466e98-ea16-4157-98bb-d41e0d5990f0 tempest-GroupsTest-1198067932 None] Create group completed successfully. Apr 24 17:09:29 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] GroupSnapshot b2c47cee-8074-471b-8b8d-99ba9ca03e53: creating. Apr 24 17:09:29 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] Group snapshot b2c47cee-8074-471b-8b8d-99ba9ca03e53: creating. {{(pid=81986) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bce2d69c-4271-40be-b1ed-9244ca7dd0dd" returned: 0 in 0.585s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Lock "cinder-quobyte-bce2d69c-4271-40be-b1ed-9244ca7dd0dd" released by "delete_volume" :: held 1.273s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] Creating offline snapshot 6f24742a-6278-4636-8210-54a9d7836235 of volume 27a55c79-48b9-415b-a490-3ab2c69f029d {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[b360fc08-c6e4-4e47-b0f0-3cf7d1a1a47b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Created reservations ['1d8dfbec-f897-4f24-afd2-29709a4559cb', 'a77d4f46-7e74-4ab4-8950-521abb2baa07', 'a0783d54-0a4c-484d-96fa-df033f50f5f1', '1c413aac-9206-41cc-bae3-e975655818bc'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:29 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d Apr 24 17:09:29 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:29 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:29 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:29 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.491s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:29 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Deleted volume successfully. Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bf9e506-8c4b-460b-8d92-e0a78593807c tempest-VolumesCloneNegativeTest-1458251242 None] Lock "cinder-bce2d69c-4271-40be-b1ed-9244ca7dd0dd-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:29 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d" returned: 0 in 0.661s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:29 devstack sudo[86943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 1G Apr 24 17:09:29 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:INSERT=54,cinder:SELECT=217,cinder:UPDATE=238,cinder:DELETE=8 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Flow 'volume_create_manager' (8f1499f5-ae88-47cd-8333-5c8e0d7dc0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b9ae6e-78a7-4979-96b4-d8438d6179e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b9ae6e-78a7-4979-96b4-d8438d6179e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821025407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba84521a-67ab-4bcc-b098-eaac525323f5,host='devstack@QuobyteHD#QuobyteHD',id=1648648b-620b-42fb-9849-689e01708c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cd2cafdf6e4911bee999dabec7671b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:30Z,use_quota=True,user_id='7d7d1f299505477d83e346ca324c7a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54a5f6b5-d5ce-4152-ab19-4aeeaec9ddbb),volume_type_id=54a5f6b5-d5ce-4152-ab19-4aeeaec9ddbb)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324bd10f-cb75-401b-bbff-b60cc5bf06e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324bd10f-cb75-401b-bbff-b60cc5bf06e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2df374a-2a99-4db9-aadd-4e9747e583f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2df374a-2a99-4db9-aadd-4e9747e583f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1648648b-620b-42fb-9849-689e01708c4f', 'volume_name': 'volume-1648648b-620b-42fb-9849-689e01708c4f', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df488e5-d5e6-44fd-9eeb-9f1b93189c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df488e5-d5e6-44fd-9eeb-9f1b93189c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fb32ba-8f94-4223-864c-d63a2d120e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:30 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Volume 1648648b-620b-42fb-9849-689e01708c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1648648b-620b-42fb-9849-689e01708c4f', 'volume_size': 1} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:30 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 1G" returned: 0 in 0.824s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a55c79-48b9-415b-a490-3ab2c69f029d -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:30 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a55c79-48b9-415b-a490-3ab2c69f029d -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 Apr 24 17:09:30 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:31 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a55c79-48b9-415b-a490-3ab2c69f029d -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235" returned: 0 in 0.619s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:31 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:09:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:31 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 Apr 24 17:09:31 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:31 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235" returned: 0 in 0.608s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:32 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.info Apr 24 17:09:32 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Flow 'volume_create_manager' (51f5fcac-ef32-43c3-bc83-cb60950b9efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfae0ab-9248-473e-93b4-bc75fcbe5ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfae0ab-9248-473e-93b4-bc75fcbe5ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-161410652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31343ebe-a816-4029-972b-e646bc2ac7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056999e1b388477ebf82624900874dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:32Z,use_quota=True,user_id='eb2ca478b6d5426c8c70d425653ea829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55aa3c5e-8c6e-470e-a5e9-7343022a8f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55aa3c5e-8c6e-470e-a5e9-7343022a8f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7def963f-db30-48ee-9430-9465bee5c81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7def963f-db30-48ee-9430-9465bee5c81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31343ebe-a816-4029-972b-e646bc2ac7ab', 'volume_name': 'volume-31343ebe-a816-4029-972b-e646bc2ac7ab', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326b2219-5dfc-4d42-a42b-cb4ae7572898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326b2219-5dfc-4d42-a42b-cb4ae7572898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40054156-41c6-484c-8568-1cbfb031a882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:32 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Volume 31343ebe-a816-4029-972b-e646bc2ac7ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31343ebe-a816-4029-972b-e646bc2ac7ab', 'volume_size': 1} Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:32 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.info" returned: 0 in 0.595s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:32 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:09:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:32 devstack sudo[86959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.info Apr 24 17:09:32 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:33 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.info" returned: 0 in 0.485s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.914s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.454s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ba84521a-67ab-4bcc-b098-eaac525323f5,created_at=2026-04-24T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821025407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba84521a-67ab-4bcc-b098-eaac525323f5,host='devstack@QuobyteHD#QuobyteHD',id=1648648b-620b-42fb-9849-689e01708c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cd2cafdf6e4911bee999dabec7671b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:30Z,use_quota=True,user_id='7d7d1f299505477d83e346ca324c7a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54a5f6b5-d5ce-4152-ab19-4aeeaec9ddbb),volume_type_id=54a5f6b5-d5ce-4152-ab19-4aeeaec9ddbb)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Creating volume 1648648b-620b-42fb-9849-689e01708c4f {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:33 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:33 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f 1073741824 Apr 24 17:09:33 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (8541d789-817a-4bbb-a157-08c2656568df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e3c1fd-727f-4f3e-9f4b-30bca7ba4474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e3c1fd-727f-4f3e-9f4b-30bca7ba4474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1018925422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6469f2-b0f5-4dc8-968c-66e2c141d1d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:33Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44fdc1a-4a10-4bc1-af5d-879cb3cbbc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44fdc1a-4a10-4bc1-af5d-879cb3cbbc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37cee986-0a6a-4fcd-8604-01b7177f1cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37cee986-0a6a-4fcd-8604-01b7177f1cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e6469f2-b0f5-4dc8-968c-66e2c141d1d0', 'volume_name': 'volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045960fc-031f-4f00-a04d-9f0fb8881741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045960fc-031f-4f00-a04d-9f0fb8881741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1602a77a-6e3b-45c6-a75d-16b8648296e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:33 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Volume 5e6469f2-b0f5-4dc8-968c-66e2c141d1d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0', 'volume_size': 1} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:33 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-875ee77f-72d1-4a42-884d-da060e505325 tempest-GroupSnapshotsTest-134446929 None] group_snapshot b2c47cee-8074-471b-8b8d-99ba9ca03e53: created successfully Apr 24 17:09:33 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] group_snapshot b2c47cee-8074-471b-8b8d-99ba9ca03e53: deleting Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] group_snapshot b2c47cee-8074-471b-8b8d-99ba9ca03e53: deleting {{(pid=81986) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-27a55c79-48b9-415b-a490-3ab2c69f029d" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-27a55c79-48b9-415b-a490-3ab2c69f029d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-6f24742a-6278-4636-8210-54a9d7836235" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-6f24742a-6278-4636-8210-54a9d7836235" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Deleting offline snapshot 6f24742a-6278-4636-8210-54a9d7836235 of volume 27a55c79-48b9-415b-a490-3ab2c69f029d {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] snapshot_file for this snap is: volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[b875395d-6806-4c0e-a58b-1765bf2f14a2]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:33 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 Apr 24 17:09:33 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:33 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f 1073741824" returned: 0 in 0.730s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:33 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f Apr 24 17:09:33 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:34 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235" returned: 0 in 0.565s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27a55c79-48b9-415b-a490-3ab2c69f029d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edb9111-6b11-4901-ba06-d488ae7cc80f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:34 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f" returned: 0 in 0.480s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:34 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d Apr 24 17:09:34 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.079s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-161410652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31343ebe-a816-4029-972b-e646bc2ac7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056999e1b388477ebf82624900874dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:32Z,use_quota=True,user_id='eb2ca478b6d5426c8c70d425653ea829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Creating volume 31343ebe-a816-4029-972b-e646bc2ac7ab {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:34 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fb32ba-8f94-4223-864c-d63a2d120e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1648648b-620b-42fb-9849-689e01708c4f', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019f5e7b-dc5a-4367-8e47-c23c4cc08535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:34 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab 1073741824 Apr 24 17:09:34 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:34 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Volume volume-1648648b-620b-42fb-9849-689e01708c4f (1648648b-620b-42fb-9849-689e01708c4f): created successfully Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019f5e7b-dc5a-4367-8e47-c23c4cc08535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Flow 'volume_create_manager' (8f1499f5-ae88-47cd-8333-5c8e0d7dc0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:34 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-c3cb7606-dc42-4d67-9576-92d852f7bacf tempest-GroupsTest-1198067932 None] Created volume successfully. Apr 24 17:09:34 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d" returned: 0 in 0.528s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:34 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 Apr 24 17:09:34 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:35 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab 1073741824" returned: 0 in 0.668s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:35 devstack sudo[86993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab Apr 24 17:09:35 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Acquiring lock "cinder-quobyte-1648648b-620b-42fb-9849-689e01708c4f" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Lock "cinder-quobyte-1648648b-620b-42fb-9849-689e01708c4f" acquired by "delete_volume" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[06adad63-9768-4850-8fcc-4eff911b5c4c]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:35 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235" returned: 0 in 0.668s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:35 devstack sudo[86999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235 Apr 24 17:09:35 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:35 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f Apr 24 17:09:35 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:35 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab" returned: 0 in 0.523s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.380s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1018925422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6469f2-b0f5-4dc8-968c-66e2c141d1d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:33Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Creating volume 5e6469f2-b0f5-4dc8-968c-66e2c141d1d0 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:35 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:35 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0 1073741824 Apr 24 17:09:35 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40054156-41c6-484c-8568-1cbfb031a882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31343ebe-a816-4029-972b-e646bc2ac7ab', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8315f3ce-dd32-49ca-bd5b-8666f87cef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:35 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Volume volume-31343ebe-a816-4029-972b-e646bc2ac7ab (31343ebe-a816-4029-972b-e646bc2ac7ab): created successfully Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8315f3ce-dd32-49ca-bd5b-8666f87cef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Flow 'volume_create_manager' (51f5fcac-ef32-43c3-bc83-cb60950b9efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:35 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e6f55996-a062-473d-ba65-f89bc32173ad tempest-VolumesTransfersV357Test-487635359 None] Created volume successfully. Apr 24 17:09:35 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d.6f24742a-6278-4636-8210-54a9d7836235" returned: 0 in 0.507s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-6f24742a-6278-4636-8210-54a9d7836235" released by "_delete_snapshot" :: held 2.381s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-27a55c79-48b9-415b-a490-3ab2c69f029d" released by "delete_snapshot" :: held 2.409s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:36 devstack cinder-volume[81986]: WARNING cinder.quota [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1188907751 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1188907751, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:36 devstack cinder-volume[81986]: WARNING cinder.quota [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1188907751 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1188907751, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:36 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f" returned: 0 in 0.643s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] Created reservations ['ca88f878-aa0e-4bb8-96ba-90a491aac2f1', '29f8fc97-053b-420d-a855-8c30a8abbc4f', 'a349bd60-2bd4-4051-8774-66d18ffedfbe', 'd18aa790-ae65-4262-a552-abf0caf42a6b'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:36 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f Apr 24 17:09:36 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:36 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d412d77b-2c97-4fbe-b806-6f9909918793 tempest-GroupSnapshotsTest-134446929 None] group_snapshot b2c47cee-8074-471b-8b8d-99ba9ca03e53: deleted successfully Apr 24 17:09:36 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0 1073741824" returned: 0 in 0.627s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:36 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0 Apr 24 17:09:36 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:36 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1648648b-620b-42fb-9849-689e01708c4f" returned: 0 in 0.557s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Lock "cinder-quobyte-1648648b-620b-42fb-9849-689e01708c4f" released by "delete_volume" :: held 1.249s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Created reservations ['b7f3f43a-dc0c-47a8-859e-4f59cd4d8419'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:36 devstack cinder-volume[81986]: WARNING cinder.quota [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1783841956 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1783841956, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:36 devstack cinder-volume[81986]: WARNING cinder.quota [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1783841956 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1783841956, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Created reservations ['520c8729-f724-4188-95b3-c3e564453443', '939f961f-804a-4bb3-86ce-e8bfba470326', 'd125826e-0caf-4f15-9d66-efc2148eae19', '26f05955-79bf-45a6-9c96-c9987e16227a'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:36 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0" returned: 0 in 0.570s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:36 devstack sudo[87018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:36 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1602a77a-6e3b-45c6-a75d-16b8648296e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:36 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f333ea-d588-4b03-82fc-5620ae88aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:37 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Volume volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0 (5e6469f2-b0f5-4dc8-968c-66e2c141d1d0): created successfully Apr 24 17:09:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f333ea-d588-4b03-82fc-5620ae88aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:37 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (8541d789-817a-4bbb-a157-08c2656568df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:37 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3b234517-af7d-4a07-8eac-c5a208c18478 tempest-VolumesGetTest-1722052253 None] Created volume successfully. Apr 24 17:09:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "cinder-quobyte-27a55c79-48b9-415b-a490-3ab2c69f029d" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-27a55c79-48b9-415b-a490-3ab2c69f029d" acquired by "delete_volume" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:37 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-91959819-0e68-4d1e-96aa-a876f1f557b6 tempest-VolumesTransfersV357Test-1159207387 None] Transfer volume completed successfully. Apr 24 17:09:37 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a97030-a8f0-4850-b4c7-4be272236234]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:37 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d Apr 24 17:09:37 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:37 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.570s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:37 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:37 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0bf4aeb4-56d2-4a41-8750-310ffc2c256a tempest-GroupsTest-1198067932 None] Delete group completed successfully. Apr 24 17:09:37 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d" returned: 0 in 0.605s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:37 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d Apr 24 17:09:37 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (8974fcec-a835-4e32-837d-383063dcf435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e24e056-c55a-4b9c-bd9b-e27f3af5c40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e24e056-c55a-4b9c-bd9b-e27f3af5c40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1950357455',display_name='tempest-VolumesGetTest-Volume-138734276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8505fd-563d-4854-b7e8-e32745fbebce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:38Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9407a6b9-fcb5-4edf-b4b4-25caa4d37139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9407a6b9-fcb5-4edf-b4b4-25caa4d37139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13d319f-0a91-4cf7-aeee-0b4ae7471ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13d319f-0a91-4cf7-aeee-0b4ae7471ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d8505fd-563d-4854-b7e8-e32745fbebce', 'volume_name': 'volume-8d8505fd-563d-4854-b7e8-e32745fbebce', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0092f25b-719d-4e7a-8937-8b4eff5d896a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0092f25b-719d-4e7a-8937-8b4eff5d896a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da2e05b-a94b-4366-a782-b837ed1c9b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:38 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Volume 8d8505fd-563d-4854-b7e8-e32745fbebce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d8505fd-563d-4854-b7e8-e32745fbebce', 'volume_size': 1} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1950357455',display_name='tempest-VolumesGetTest-Volume-138734276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8505fd-563d-4854-b7e8-e32745fbebce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:38Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Creating volume 8d8505fd-563d-4854-b7e8-e32745fbebce {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:38 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:38 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce 1073741824 Apr 24 17:09:38 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-76795c96-f7fd-4032-9a71-54005a2a3599 tempest-GroupsTest-1198067932 None] Created reservations ['e67fc181-19da-475a-a0d7-5560cbf04dde'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-76795c96-f7fd-4032-9a71-54005a2a3599 tempest-GroupsTest-1198067932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-76795c96-f7fd-4032-9a71-54005a2a3599 tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-76795c96-f7fd-4032-9a71-54005a2a3599 tempest-GroupsTest-1198067932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-76795c96-f7fd-4032-9a71-54005a2a3599 tempest-GroupsTest-1198067932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-76795c96-f7fd-4032-9a71-54005a2a3599 tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-76795c96-f7fd-4032-9a71-54005a2a3599 tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Acquiring lock "cinder-31343ebe-a816-4029-972b-e646bc2ac7ab-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Lock "cinder-31343ebe-a816-4029-972b-e646bc2ac7ab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:38 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:38 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Acquiring lock "cinder-quobyte-31343ebe-a816-4029-972b-e646bc2ac7ab" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:38 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Lock "cinder-quobyte-31343ebe-a816-4029-972b-e646bc2ac7ab" acquired by "delete_volume" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-27a55c79-48b9-415b-a490-3ab2c69f029d" returned: 0 in 0.575s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[6617e9f4-8a37-478b-ae47-f8986aa4b9f8]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Lock "cinder-quobyte-27a55c79-48b9-415b-a490-3ab2c69f029d" released by "delete_volume" :: held 1.259s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Created reservations ['23a43e96-695b-4f3a-9e4a-3c04a8d9763a'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:38 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab Apr 24 17:09:38 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:38 devstack cinder-volume[81986]: WARNING cinder.quota [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1188907751 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1188907751, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Created reservations ['0166408a-6feb-49c0-9966-fbe6ddc69eed', 'b069b310-58ce-46e0-8fa8-1abab98b7349', '739d5426-cd11-4227-9ee6-19a0ffac2e1a', 'cfd37fc9-f1b7-444d-b74b-b048a2b829d6'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:38 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:38 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:38 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-76795c96-f7fd-4032-9a71-54005a2a3599 tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.555s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-76795c96-f7fd-4032-9a71-54005a2a3599 tempest-GroupsTest-1198067932 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:38 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-76795c96-f7fd-4032-9a71-54005a2a3599 tempest-GroupsTest-1198067932 None] Delete group completed successfully. Apr 24 17:09:38 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce 1073741824" returned: 0 in 0.731s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:38 devstack sudo[87043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce Apr 24 17:09:38 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:39 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab" returned: 0 in 0.661s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:39 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab Apr 24 17:09:39 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:39 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.570s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:39 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5c8bc0b4-abe1-4896-80bd-cdd21a09bc8c tempest-GroupSnapshotsTest-134446929 None] Delete group completed successfully. Apr 24 17:09:39 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce" returned: 0 in 0.540s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da2e05b-a94b-4366-a782-b837ed1c9b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d8505fd-563d-4854-b7e8-e32745fbebce', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eae1f32-3de6-4845-981d-b8da05c4f23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:39 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Volume volume-8d8505fd-563d-4854-b7e8-e32745fbebce (8d8505fd-563d-4854-b7e8-e32745fbebce): created successfully Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eae1f32-3de6-4845-981d-b8da05c4f23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (8974fcec-a835-4e32-837d-383063dcf435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:39 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-abfe5eb0-ad3c-425c-abc4-dfd2c5c4a5c7 tempest-VolumesGetTest-1722052253 None] Created volume successfully. Apr 24 17:09:39 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-31343ebe-a816-4029-972b-e646bc2ac7ab" returned: 0 in 0.563s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:39 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5c7dd9d8-be9d-4e24-9e6a-88921f2a8d95 tempest-GroupsTest-1198067932 None] Group tempest-GroupsTest-Group-352981173: creating Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Lock "cinder-quobyte-31343ebe-a816-4029-972b-e646bc2ac7ab" released by "delete_volume" :: held 1.274s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:39 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5c7dd9d8-be9d-4e24-9e6a-88921f2a8d95 tempest-GroupsTest-1198067932 None] Group tempest-GroupsTest-Group-352981173: created successfully Apr 24 17:09:39 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5c7dd9d8-be9d-4e24-9e6a-88921f2a8d95 tempest-GroupsTest-1198067932 None] Create group completed successfully. Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Created reservations ['77fa7103-7ca5-4b74-875c-18657ca70033', 'd600675c-d961-45ba-955a-2babeae8832d', 'b5172fe9-777a-4269-a6b4-d175c9ac8a50', '451ab458-0391-43d5-9cc7-7c906bd0ac6c'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:39 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:39 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:40 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-8d8505fd-563d-4854-b7e8-e32745fbebce-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:40 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Lock "cinder-8d8505fd-563d-4854-b7e8-e32745fbebce-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:40 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.601s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:40 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:40 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Deleted volume successfully. Apr 24 17:09:40 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-quobyte-8d8505fd-563d-4854-b7e8-e32745fbebce" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:40 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-8d8505fd-563d-4854-b7e8-e32745fbebce" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:40 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-737255ab-12bc-43d8-924c-3c449edbf4bb tempest-VolumesTransfersV357Test-925851226 None] Lock "cinder-31343ebe-a816-4029-972b-e646bc2ac7ab-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:40 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e8f7df-030f-43b9-a6bd-032916949099]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:40 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce Apr 24 17:09:40 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Flow 'volume_create_manager' (c91be857-558b-4a87-9cf8-c600735ba11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:41 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac4210d-4aaa-4fb9-8942-8c4da9923a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce" returned: 0 in 0.683s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:41 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce Apr 24 17:09:41 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac4210d-4aaa-4fb9-8942-8c4da9923a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-193596212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e51b78-f76d-42b9-960d-0532f75de9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056999e1b388477ebf82624900874dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:41Z,use_quota=True,user_id='eb2ca478b6d5426c8c70d425653ea829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439e7420-6a01-44e1-a49b-b98d099099b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439e7420-6a01-44e1-a49b-b98d099099b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81fe959-06f3-4faf-8c39-817bf250d503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81fe959-06f3-4faf-8c39-817bf250d503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e51b78-f76d-42b9-960d-0532f75de9a2', 'volume_name': 'volume-e0e51b78-f76d-42b9-960d-0532f75de9a2', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ffe5f66-cde6-4121-94de-c423776f5adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ffe5f66-cde6-4121-94de-c423776f5adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f89701d-eaf2-4521-85d6-ea229ed5dc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:41 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Volume e0e51b78-f76d-42b9-960d-0532f75de9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e51b78-f76d-42b9-960d-0532f75de9a2', 'volume_size': 1} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-193596212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e51b78-f76d-42b9-960d-0532f75de9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056999e1b388477ebf82624900874dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:41Z,use_quota=True,user_id='eb2ca478b6d5426c8c70d425653ea829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Creating volume e0e51b78-f76d-42b9-960d-0532f75de9a2 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:41 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:41 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2 1073741824 Apr 24 17:09:41 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Flow 'volume_create_manager' (905ea549-86dc-432f-9c90-4e69109c3e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d24397-4891-4e71-945b-979b9faab1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d24397-4891-4e71-945b-979b9faab1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1898441983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ef430b1-0f2d-42c3-9ae0-113c3b8364a6,host='devstack@QuobyteHD#QuobyteHD',id=f6563e48-0a84-4fd2-b130-ebb8f243a159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cd2cafdf6e4911bee999dabec7671b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:41Z,use_quota=True,user_id='7d7d1f299505477d83e346ca324c7a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e163cdee-907b-4f31-b742-3b8629a1aafa),volume_type_id=e163cdee-907b-4f31-b742-3b8629a1aafa)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68adc275-27fe-40ed-b18a-8e68144c1a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68adc275-27fe-40ed-b18a-8e68144c1a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc1924f-5f6a-4656-87ed-e92d41c59599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc1924f-5f6a-4656-87ed-e92d41c59599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6563e48-0a84-4fd2-b130-ebb8f243a159', 'volume_name': 'volume-f6563e48-0a84-4fd2-b130-ebb8f243a159', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce872f68-6f43-4d54-b4bc-426b3c4b50d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce872f68-6f43-4d54-b4bc-426b3c4b50d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c97250-0b67-4f65-a443-3d98021541d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:41 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Volume f6563e48-0a84-4fd2-b130-ebb8f243a159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6563e48-0a84-4fd2-b130-ebb8f243a159', 'volume_size': 1} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:41 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8d8505fd-563d-4854-b7e8-e32745fbebce" returned: 0 in 0.531s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-8d8505fd-563d-4854-b7e8-e32745fbebce" released by "delete_volume" :: held 1.280s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Created reservations ['a3482bc7-b4e6-40ad-b7ba-604ddf374913', 'f0ed354a-b715-493d-bc50-952958f70d49', 'e1481319-0e64-4112-b216-27caf568caf9', '8b109448-1a4d-4d24-925f-ec938ef50bce'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:41 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:41 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:42 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2 1073741824" returned: 0 in 0.815s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:42 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2 Apr 24 17:09:42 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:42 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.529s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:42 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Deleted volume successfully. Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2ad336ef-9aa3-493f-9891-0eb062434df7 tempest-VolumesGetTest-1722052253 None] Lock "cinder-8d8505fd-563d-4854-b7e8-e32745fbebce-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Lock "cinder-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-quobyte-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[808b5eea-566d-4c86-a32d-dcbe4b839ddd]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:42 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2" returned: 0 in 0.648s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ef430b1-0f2d-42c3-9ae0-113c3b8364a6,created_at=2026-04-24T15:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1898441983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ef430b1-0f2d-42c3-9ae0-113c3b8364a6,host='devstack@QuobyteHD#QuobyteHD',id=f6563e48-0a84-4fd2-b130-ebb8f243a159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cd2cafdf6e4911bee999dabec7671b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:41Z,use_quota=True,user_id='7d7d1f299505477d83e346ca324c7a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e163cdee-907b-4f31-b742-3b8629a1aafa),volume_type_id=e163cdee-907b-4f31-b742-3b8629a1aafa)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Creating volume f6563e48-0a84-4fd2-b130-ebb8f243a159 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:42 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f89701d-eaf2-4521-85d6-ea229ed5dc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e51b78-f76d-42b9-960d-0532f75de9a2', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:42 devstack sudo[87077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159 1073741824 Apr 24 17:09:42 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc4af65-34dc-4b5b-9d7e-b1f4bd80fc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:42 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0 Apr 24 17:09:42 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:42 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Volume volume-e0e51b78-f76d-42b9-960d-0532f75de9a2 (e0e51b78-f76d-42b9-960d-0532f75de9a2): created successfully Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc4af65-34dc-4b5b-9d7e-b1f4bd80fc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Flow 'volume_create_manager' (c91be857-558b-4a87-9cf8-c600735ba11c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:42 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-20cd8892-ed37-4e98-9c4a-67b0c97d1ebc tempest-VolumesTransfersV357Test-487635359 None] Created volume successfully. Apr 24 17:09:43 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0" returned: 0 in 0.650s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:43 devstack sudo[87086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0 Apr 24 17:09:43 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Acquiring lock "cinder-e0e51b78-f76d-42b9-960d-0532f75de9a2-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Lock "cinder-e0e51b78-f76d-42b9-960d-0532f75de9a2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Acquiring lock "cinder-quobyte-e0e51b78-f76d-42b9-960d-0532f75de9a2" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Lock "cinder-quobyte-e0e51b78-f76d-42b9-960d-0532f75de9a2" acquired by "delete_volume" :: waited 0.013s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86a3ab8-724d-42b9-8767-f19ddb6c5a6e]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:43 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159 1073741824" returned: 0 in 0.810s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:43 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159 Apr 24 17:09:43 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:43 devstack sudo[87088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2 Apr 24 17:09:43 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:43 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0" returned: 0 in 0.549s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0" released by "delete_volume" :: held 1.238s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Created reservations ['cc2d487a-fda0-456b-99b6-bef38ff3e4e1', 'b3563ac7-f7f7-4f26-a9b9-8d73a7522381', '1861af5f-6914-44f7-83e2-8fb81d21413e', 'd55f7398-c50c-4bff-8b12-448471b94885'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:44 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:44 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:44 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159" returned: 0 in 0.541s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c97250-0b67-4f65-a443-3d98021541d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6563e48-0a84-4fd2-b130-ebb8f243a159', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87edb78-271d-4bae-ab2a-465e47968670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:44 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2" returned: 0 in 0.623s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:44 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Volume volume-f6563e48-0a84-4fd2-b130-ebb8f243a159 (f6563e48-0a84-4fd2-b130-ebb8f243a159): created successfully Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87edb78-271d-4bae-ab2a-465e47968670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Flow 'volume_create_manager' (905ea549-86dc-432f-9c90-4e69109c3e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:44 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2 Apr 24 17:09:44 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:44 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-76b92c38-1866-4868-bf09-ac0968ff19e0 tempest-GroupsTest-1198067932 None] Created volume successfully. Apr 24 17:09:44 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.529s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:44 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Deleted volume successfully. Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d5ca4a99-0684-4b63-af95-4b1419a27d71 tempest-VolumesGetTest-1722052253 None] Lock "cinder-5e6469f2-b0f5-4dc8-968c-66e2c141d1d0-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:44 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e0e51b78-f76d-42b9-960d-0532f75de9a2" returned: 0 in 0.507s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Lock "cinder-quobyte-e0e51b78-f76d-42b9-960d-0532f75de9a2" released by "delete_volume" :: held 1.172s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Created reservations ['0388af9e-17bf-414a-8208-898eb2fbada0', '588fc595-9a46-416e-850b-2f93e0b9ffe2', 'd44433d9-c3e5-4d50-a79f-283863476c49', '56e68db7-d756-4598-bf5b-f0b8a10fee86'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:44 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:44 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:45 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a78d5e85-577b-41bb-bebb-f7dbcfe48b4e tempest-GroupsV314Test-2068339354 None] Group tempest-GroupsV314Test-Group-526980085: creating Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Flow 'volume_create_manager' (a4ff67a4-c5d6-4b57-a2c3-64a81985d845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e53202-cbe7-46d3-a6bb-989d7b9f09b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:45 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a78d5e85-577b-41bb-bebb-f7dbcfe48b4e tempest-GroupsV314Test-2068339354 None] Group tempest-GroupsV314Test-Group-526980085: created successfully Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e53202-cbe7-46d3-a6bb-989d7b9f09b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847551390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ef430b1-0f2d-42c3-9ae0-113c3b8364a6,host='devstack@QuobyteHD#QuobyteHD',id=a3d973f2-7627-4c93-a007-aa354412c085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cd2cafdf6e4911bee999dabec7671b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:45Z,use_quota=True,user_id='7d7d1f299505477d83e346ca324c7a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e163cdee-907b-4f31-b742-3b8629a1aafa),volume_type_id=e163cdee-907b-4f31-b742-3b8629a1aafa)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c2d4bf-f199-47eb-87c6-937c152cb01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c2d4bf-f199-47eb-87c6-937c152cb01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e97e67-388f-405a-ae96-c4cbb0d14ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e97e67-388f-405a-ae96-c4cbb0d14ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d973f2-7627-4c93-a007-aa354412c085', 'volume_name': 'volume-a3d973f2-7627-4c93-a007-aa354412c085', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f511ce10-2003-4290-9a1e-88c7ac4eefa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f511ce10-2003-4290-9a1e-88c7ac4eefa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9cc6bf-eddd-4ca4-a292-99542a574582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:45 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Volume a3d973f2-7627-4c93-a007-aa354412c085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d973f2-7627-4c93-a007-aa354412c085', 'volume_size': 1} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ef430b1-0f2d-42c3-9ae0-113c3b8364a6,created_at=2026-04-24T15:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847551390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ef430b1-0f2d-42c3-9ae0-113c3b8364a6,host='devstack@QuobyteHD#QuobyteHD',id=a3d973f2-7627-4c93-a007-aa354412c085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cd2cafdf6e4911bee999dabec7671b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:45Z,use_quota=True,user_id='7d7d1f299505477d83e346ca324c7a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e163cdee-907b-4f31-b742-3b8629a1aafa),volume_type_id=e163cdee-907b-4f31-b742-3b8629a1aafa)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Creating volume a3d973f2-7627-4c93-a007-aa354412c085 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:45 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:45 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a78d5e85-577b-41bb-bebb-f7dbcfe48b4e tempest-GroupsV314Test-2068339354 None] Create group completed successfully. Apr 24 17:09:45 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085 1073741824 Apr 24 17:09:45 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (2b3e053e-f449-4d23-a12e-aaa53fce6299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f4c250-fd8d-4a4f-9d4d-e4729ee5f7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f4c250-fd8d-4a4f-9d4d-e4729ee5f7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-564797970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d053c1-f708-497a-bb36-a5ecd1cb77a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:45Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f4187a-2208-46cb-961b-cb00b100caf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f4187a-2208-46cb-961b-cb00b100caf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dba709a-df0b-4bca-afac-c7a4a443f948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dba709a-df0b-4bca-afac-c7a4a443f948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d053c1-f708-497a-bb36-a5ecd1cb77a9', 'volume_name': 'volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7de5437-2fef-467d-b18b-b7cf442851b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7de5437-2fef-467d-b18b-b7cf442851b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2295a295-8229-4746-9a30-9885a452f6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:45 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Volume 45d053c1-f708-497a-bb36-a5ecd1cb77a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9', 'volume_size': 1} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:45 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.621s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:45 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Deleted volume successfully. Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e2fabb6-3062-4d4e-9f7c-349086794844 tempest-VolumesTransfersV357Test-925851226 None] Lock "cinder-e0e51b78-f76d-42b9-960d-0532f75de9a2-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:45 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085 1073741824" returned: 0 in 0.718s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:45 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085 Apr 24 17:09:45 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:46 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085" returned: 0 in 0.566s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.061s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-564797970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d053c1-f708-497a-bb36-a5ecd1cb77a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:45Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Creating volume 45d053c1-f708-497a-bb36-a5ecd1cb77a9 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:46 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9cc6bf-eddd-4ca4-a292-99542a574582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d973f2-7627-4c93-a007-aa354412c085', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2959bc-562f-4fc0-bcbb-8578af31d943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:46 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 1073741824 Apr 24 17:09:46 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:46 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Volume volume-a3d973f2-7627-4c93-a007-aa354412c085 (a3d973f2-7627-4c93-a007-aa354412c085): created successfully Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2959bc-562f-4fc0-bcbb-8578af31d943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Flow 'volume_create_manager' (a4ff67a4-c5d6-4b57-a2c3-64a81985d845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:46 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-bcf7ed4b-7379-4a7d-a841-c4b15c7b3709 tempest-GroupsTest-1198067932 None] Created volume successfully. Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Flow 'volume_create_manager' (5a1b6116-dc3a-4e1b-aee3-4b925419231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8102744a-84ec-42f9-9522-4b71b70696a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8102744a-84ec-42f9-9522-4b71b70696a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2110755879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=066c04d6-65d6-4a71-8118-af96dc74c8e0,host='devstack@QuobyteHD#QuobyteHD',id=3ac74dd9-61d7-447f-9ebc-4fded6482a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc22dcb4e6cd4b339ffedfb0837a3273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:47Z,use_quota=True,user_id='47b13f77a72a456987d0ebdee41bc62a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4ce839-43b4-485b-9488-efdfa94509e0),volume_type_id=2b4ce839-43b4-485b-9488-efdfa94509e0)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94913620-982a-4625-ad0e-32d5c299d959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94913620-982a-4625-ad0e-32d5c299d959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a429fa-f786-4ba8-adbc-fea888d7f6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a429fa-f786-4ba8-adbc-fea888d7f6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac74dd9-61d7-447f-9ebc-4fded6482a30', 'volume_name': 'volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0602034f-f51a-4b89-a0af-0631ff9762a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0602034f-f51a-4b89-a0af-0631ff9762a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d479d70-11c3-4548-b64e-78213f37b423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:46 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Volume 3ac74dd9-61d7-447f-9ebc-4fded6482a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30', 'volume_size': 1} Apr 24 17:09:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:47 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 1073741824" returned: 0 in 0.708s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:47 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 Apr 24 17:09:47 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:47 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-7bed3b24-e1fe-4561-8152-fa9d8f892cf3 tempest-GroupsTest-1198067932 None] Update group completed successfully. Apr 24 17:09:47 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9" returned: 0 in 0.631s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=066c04d6-65d6-4a71-8118-af96dc74c8e0,created_at=2026-04-24T15:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2110755879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=066c04d6-65d6-4a71-8118-af96dc74c8e0,host='devstack@QuobyteHD#QuobyteHD',id=3ac74dd9-61d7-447f-9ebc-4fded6482a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc22dcb4e6cd4b339ffedfb0837a3273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:47Z,use_quota=True,user_id='47b13f77a72a456987d0ebdee41bc62a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4ce839-43b4-485b-9488-efdfa94509e0),volume_type_id=2b4ce839-43b4-485b-9488-efdfa94509e0)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Creating volume 3ac74dd9-61d7-447f-9ebc-4fded6482a30 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:09:47 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:47 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 1073741824 Apr 24 17:09:47 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2295a295-8229-4746-9a30-9885a452f6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5282ac16-1f23-48f5-8719-dce85e7c1632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:47 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Volume volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 (45d053c1-f708-497a-bb36-a5ecd1cb77a9): created successfully Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5282ac16-1f23-48f5-8719-dce85e7c1632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (2b3e053e-f449-4d23-a12e-aaa53fce6299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:48 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f65c48d1-3d6a-44a9-8163-2cd25771aed1 tempest-VolumesGetTest-1722052253 None] Created volume successfully. Apr 24 17:09:48 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 1073741824" returned: 0 in 0.773s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:48 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 Apr 24 17:09:48 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:48 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-822c80ed-297f-47a8-989b-7916ce6b7530 tempest-GroupsTest-1198067932 None] Update group completed successfully. Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (1647a12f-e8cc-4d67-bb0d-71b18e5c77ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c42bc5-d9aa-485e-9c8e-96b77d47d7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c42bc5-d9aa-485e-9c8e-96b77d47d7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-239118309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116f1587-676b-4866-a8ec-a32fc7935196,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=45d053c1-f708-497a-bb36-a5ecd1cb77a9,status='creating',terminated_at=None,updated_at=2026-04-24T15:09:49Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb3a19b-73c1-48e1-bd4b-4a1561b8499c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb3a19b-73c1-48e1-bd4b-4a1561b8499c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfd908e-2510-4b99-a332-f24ee07aecfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfd908e-2510-4b99-a332-f24ee07aecfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '116f1587-676b-4866-a8ec-a32fc7935196', 'volume_name': 'volume-116f1587-676b-4866-a8ec-a32fc7935196', 'volume_size': 1, 'source_volid': '45d053c1-f708-497a-bb36-a5ecd1cb77a9', 'source_volstatus': 'available'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9be1047-3ae9-4ec4-9832-d7947381cfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9be1047-3ae9-4ec4-9832-d7947381cfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e073bf-8f9e-40cd-bdf5-ed4ed4e46046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:49 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Volume 116f1587-676b-4866-a8ec-a32fc7935196: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-116f1587-676b-4866-a8ec-a32fc7935196', 'volume_size': 1, 'source_volid': '45d053c1-f708-497a-bb36-a5ecd1cb77a9', 'source_volstatus': 'available'} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:49 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30" returned: 0 in 0.553s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.062s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:49 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Cloning volume 45d053c1-f708-497a-bb36-a5ecd1cb77a9 to volume 116f1587-676b-4866-a8ec-a32fc7935196 Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d479d70-11c3-4548-b64e-78213f37b423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3408fb38-3a77-48a7-92e8-6e3d00df531c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:09:49 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Volume volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 (3ac74dd9-61d7-447f-9ebc-4fded6482a30): created successfully Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3408fb38-3a77-48a7-92e8-6e3d00df531c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Flow 'volume_create_manager' (5a1b6116-dc3a-4e1b-aee3-4b925419231a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:09:49 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-19871f00-b79b-4140-8a8c-252c53aab246 tempest-GroupsV314Test-2068339354 None] Created volume successfully. Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Creating offline snapshot 611fd543-c772-44fe-ab14-a289f2773dfe of volume 45d053c1-f708-497a-bb36-a5ecd1cb77a9 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a6504b-bd5d-4093-a3eb-94c41e9dff72]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:49 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 Apr 24 17:09:49 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:50 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9" returned: 0 in 0.636s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:50 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe 1G Apr 24 17:09:50 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:50 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Acquiring lock "cinder-quobyte-a3d973f2-7627-4c93-a007-aa354412c085" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:50 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Lock "cinder-quobyte-a3d973f2-7627-4c93-a007-aa354412c085" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:50 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7184b2-5a99-43e9-93d9-8b3dec402da6]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:50 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085 Apr 24 17:09:50 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:50 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe 1G" returned: 0 in 0.733s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:50 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe Apr 24 17:09:50 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:51 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085" returned: 0 in 0.624s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:51 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085 Apr 24 17:09:51 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:51 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe" returned: 0 in 0.793s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:51 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe is being set with open permissions: ugo+rw Apr 24 17:09:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:51 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a3d973f2-7627-4c93-a007-aa354412c085" returned: 0 in 0.586s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Lock "cinder-quobyte-a3d973f2-7627-4c93-a007-aa354412c085" released by "delete_volume" :: held 1.258s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Acquiring lock "cinder-quobyte-f6563e48-0a84-4fd2-b130-ebb8f243a159" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:51 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe Apr 24 17:09:51 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Lock "cinder-quobyte-f6563e48-0a84-4fd2-b130-ebb8f243a159" acquired by "delete_volume" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:51 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee7c6fc-ebe4-484f-b5ec-32944caebe91]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:51 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159 Apr 24 17:09:51 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:52 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe" returned: 0 in 0.560s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:52 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.info Apr 24 17:09:52 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:52 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159" returned: 0 in 0.653s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:52 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159 Apr 24 17:09:52 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:52 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.info" returned: 0 in 0.559s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:52 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.info is being set with open permissions: ugo+rw Apr 24 17:09:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:52 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.info Apr 24 17:09:52 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:52 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f6563e48-0a84-4fd2-b130-ebb8f243a159" returned: 0 in 0.560s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:52 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Lock "cinder-quobyte-f6563e48-0a84-4fd2-b130-ebb8f243a159" released by "delete_volume" :: held 1.262s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:09:52 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Created reservations ['e833b6f6-620e-4bcb-b943-9c8c632a2b88'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:52 devstack cinder-volume[81986]: WARNING cinder.quota [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1577875174 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1577875174, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:52 devstack cinder-volume[81986]: WARNING cinder.quota [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1577875174 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1577875174, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Created reservations ['38716bbf-bcdb-4b58-9b2a-bd092df2c33e', '52ea5644-d105-4b02-85e0-822a2e75fe73', 'd7450fd4-7349-4e00-b4fe-3dd89d91e802', '4269ee4c-0ef8-4c55-99d3-7e29a85a0a7f'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Created reservations ['c8560891-6079-442b-9d77-e7ee6ecc08f7', 'd149b384-c2b1-4c80-8a12-133c3ca5c234', '3a2b8ffe-0053-4e22-9bf2-231130799ba1', '33dfd28c-2462-4105-8d06-095fefce3cbe'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:53 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.info" returned: 0 in 0.527s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:53 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:09:53 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-quobyte-116f1587-676b-4866-a8ec-a32fc7935196" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-116f1587-676b-4866-a8ec-a32fc7935196" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] snapshot: 611fd543-c772-44fe-ab14-a289f2773dfe, volume: 116f1587-676b-4866-a8ec-a32fc7935196, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3a0482-3354-485a-9d8b-95d32d2aa8da]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:53 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe Apr 24 17:09:53 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:53 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.554s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:53 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:09:53 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f6d11fbe-a316-40ad-bd81-0dfb979b8a9b tempest-GroupsTest-1198067932 None] Delete group completed successfully. Apr 24 17:09:54 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe" returned: 0 in 0.695s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:09:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:09:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:09:54 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e9a73e-4282-425f-94af-fc310e5021af]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:09:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:54 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 Apr 24 17:09:54 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:09:54 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 24 17:09:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9" returned: 0 in 0.648s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:09:54 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196 not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:09:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:09:54 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196 Apr 24 17:09:54 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:01 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196" returned: 0 in 6.897s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:01 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41c59c6-0130-4f45-85bd-a3637551c235]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:01 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 Apr 24 17:10:01 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:02 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9" returned: 0 in 0.766s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:10:02 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Converted 1024.00 MB image at 148.43 MB/s Apr 24 17:10:02 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196 is being set with open permissions: ugo+rw Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:02 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196 Apr 24 17:10:02 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:02 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:02 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:02 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196" returned: 0 in 0.519s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-116f1587-676b-4866-a8ec-a32fc7935196" released by "_copy_volume_from_snapshot" :: held 9.640s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-quobyte-611fd543-c772-44fe-ab14-a289f2773dfe" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-611fd543-c772-44fe-ab14-a289f2773dfe" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Deleting offline snapshot 611fd543-c772-44fe-ab14-a289f2773dfe of volume 45d053c1-f708-497a-bb36-a5ecd1cb77a9 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] snapshot_file for this snap is: volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3bcd3e-6201-4079-a452-f4d730bd5385]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:03 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe Apr 24 17:10:03 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=102,cinder:UPDATE=103,cinder:DELETE=7,cinder:INSERT=25 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:10:03 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.638s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:03 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe" returned: 0 in 0.780s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c399737e-c885-4af6-8d47-3303522ad201]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:04 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 Apr 24 17:10:04 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:04 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9" returned: 0 in 0.773s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:04 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe Apr 24 17:10:04 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:04 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Flow 'volume_create_manager' (fe1ec5f7-dca2-4e5d-a962-12759019ce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f06fb72-afc5-43a7-8308-ac013ee788ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f06fb72-afc5-43a7-8308-ac013ee788ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1970178525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7b06cc-8aa0-4654-bbe5-5f069db72417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbfaf53b6e24b37a24c5848b950f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:05Z,use_quota=True,user_id='e45528ed28644465b86edaa06bba17cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec4a976-1b61-40ed-ae4e-1bb2884c7e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec4a976-1b61-40ed-ae4e-1bb2884c7e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a58116b-3040-42f2-a86f-7cd2c931e4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a58116b-3040-42f2-a86f-7cd2c931e4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7b06cc-8aa0-4654-bbe5-5f069db72417', 'volume_name': 'volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbdbc8d-6535-4461-b5aa-411a729c0277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbdbc8d-6535-4461-b5aa-411a729c0277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db29cacc-26db-4766-91e6-acec78483b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:05 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Volume 4e7b06cc-8aa0-4654-bbe5-5f069db72417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417', 'volume_size': 1} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:05 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe" returned: 0 in 0.664s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:05 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe Apr 24 17:10:05 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:05 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9.611fd543-c772-44fe-ab14-a289f2773dfe" returned: 0 in 0.509s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-611fd543-c772-44fe-ab14-a289f2773dfe" released by "_delete_snapshot" :: held 2.897s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.636s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 14.465s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:05 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Cloning volume 3ac74dd9-61d7-447f-9ebc-4fded6482a30 to volume 7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e073bf-8f9e-40cd-bdf5-ed4ed4e46046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116f1587-676b-4866-a8ec-a32fc7935196', 'volume_size': 1, 'source_volid': '45d053c1-f708-497a-bb36-a5ecd1cb77a9', 'source_volstatus': 'available'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:05 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0a24d6-dc2f-47b7-9abb-ff76d79a9b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:05 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Volume volume-116f1587-676b-4866-a8ec-a32fc7935196 (116f1587-676b-4866-a8ec-a32fc7935196): created successfully Apr 24 17:10:06 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0a24d6-dc2f-47b7-9abb-ff76d79a9b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:06 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (1647a12f-e8cc-4d67-bb0d-71b18e5c77ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Creating offline snapshot 73f073b2-5ef6-442a-8f9f-89db613a6999 of volume 3ac74dd9-61d7-447f-9ebc-4fded6482a30 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:10:06 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0f73eca5-5dad-457a-bc4d-195a5c2058ee tempest-VolumesGetTest-1722052253 None] Created volume successfully. Apr 24 17:10:06 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c29f53-e5cb-41ad-959e-d1b740447cd9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:06 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 Apr 24 17:10:06 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:06 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30" returned: 0 in 0.616s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:06 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 1G Apr 24 17:10:06 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:07 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 1G" returned: 0 in 0.739s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:07 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 Apr 24 17:10:07 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (ea0016a8-c82a-43e5-abe3-604ff690b620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eec346-e1e7-4cb3-bba5-d059c5e5f9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eec346-e1e7-4cb3-bba5-d059c5e5f9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1609981483',display_name='tempest-VolumesGetTest-Volume-1814889253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3e3e84-a5c8-4c55-b588-cda8decfe1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:07Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0532ac8b-c1a9-4152-840b-eb65cef76094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0532ac8b-c1a9-4152-840b-eb65cef76094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c840ac2f-31c3-4f99-ab87-29b84f971d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c840ac2f-31c3-4f99-ab87-29b84f971d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3e3e84-a5c8-4c55-b588-cda8decfe1f7', 'volume_name': 'volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b044b4-a42a-42f0-8e43-c582201921e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b044b4-a42a-42f0-8e43-c582201921e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb6d843-eb75-4e48-9b5d-434b562c9323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:07 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Volume 2e3e3e84-a5c8-4c55-b588-cda8decfe1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7', 'volume_size': 1} Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:07 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999" returned: 0 in 0.543s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:07 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:10:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:07 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 Apr 24 17:10:07 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Flow 'volume_create_manager' (60df6ab0-ecc2-419a-a0c0-1170a2551365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc76b54-321d-4b3f-a0b0-4e60eab07ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc76b54-321d-4b3f-a0b0-4e60eab07ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-946364951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a76554-ee0c-4b85-8fd9-5afff96a4839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ad73dacf720452481f54f72b0dd3c3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:08Z,use_quota=True,user_id='a8098dba1b0f479d96bbeb05c0813fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81754f3c-133c-446f-b33a-13fbb9fcd8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81754f3c-133c-446f-b33a-13fbb9fcd8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b440b20b-c1d8-4eaa-a7e7-0ae36a7cee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b440b20b-c1d8-4eaa-a7e7-0ae36a7cee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a76554-ee0c-4b85-8fd9-5afff96a4839', 'volume_name': 'volume-05a76554-ee0c-4b85-8fd9-5afff96a4839', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e88d3b4-a497-485d-bbba-6f9ffb67e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e88d3b4-a497-485d-bbba-6f9ffb67e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f475df4a-c414-4cdc-84aa-49bc3c9cb2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:08 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Volume 05a76554-ee0c-4b85-8fd9-5afff96a4839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a76554-ee0c-4b85-8fd9-5afff96a4839', 'volume_size': 1} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:08 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999" returned: 0 in 0.474s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:08 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.info Apr 24 17:10:08 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:08 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.info" returned: 0 in 0.490s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:08 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:10:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:08 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.info Apr 24 17:10:08 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:09 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.info" returned: 0 in 0.455s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Acquiring lock "cinder-quobyte-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Lock "cinder-quobyte-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] snapshot: 73f073b2-5ef6-442a-8f9f-89db613a6999, volume: 7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab91a829-de1d-407e-84c4-9d5b3eb4471f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:09 devstack sudo[87287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 Apr 24 17:10:09 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:09 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999" returned: 0 in 0.513s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:10:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:10:10 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[74abc962-03ac-407e-87f3-5b15444827eb]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:10 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 Apr 24 17:10:10 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:10 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30" returned: 0 in 0.582s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:10 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:10:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:10 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed Apr 24 17:10:10 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:15 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed" returned: 0 in 4.579s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:15 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f47f858-dda9-413b-9cb5-f5fbcad2ccc5]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:15 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 Apr 24 17:10:15 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:15 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30" returned: 0 in 0.693s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:15 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30, size 1024.00 MB, duration 4.58 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:10:15 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Converted 1024.00 MB image at 223.56 MB/s Apr 24 17:10:15 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed is being set with open permissions: ugo+rw: NotImplementedError Apr 24 17:10:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:15 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed Apr 24 17:10:15 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:16 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed" returned: 0 in 0.444s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Lock "cinder-quobyte-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed" released by "_copy_volume_from_snapshot" :: held 6.893s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Acquiring lock "cinder-quobyte-73f073b2-5ef6-442a-8f9f-89db613a6999" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Lock "cinder-quobyte-73f073b2-5ef6-442a-8f9f-89db613a6999" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Deleting offline snapshot 73f073b2-5ef6-442a-8f9f-89db613a6999 of volume 3ac74dd9-61d7-447f-9ebc-4fded6482a30 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] snapshot_file for this snap is: volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda8ff9-6897-4e00-9e3d-55434e80f888]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:16 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 Apr 24 17:10:16 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:16 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999" returned: 0 in 0.532s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc5c593-0b18-4479-baae-07a2fbe4648d]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:17 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 Apr 24 17:10:17 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:17 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30" returned: 0 in 0.520s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:17 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 Apr 24 17:10:17 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:18 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999" returned: 0 in 0.539s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:18 devstack sudo[87333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999 Apr 24 17:10:18 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:10:18 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30.73f073b2-5ef6-442a-8f9f-89db613a6999" returned: 0 in 0.440s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Lock "cinder-quobyte-73f073b2-5ef6-442a-8f9f-89db613a6999" released by "_delete_snapshot" :: held 2.120s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.541s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.435s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1970178525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7b06cc-8aa0-4654-bbe5-5f069db72417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbfaf53b6e24b37a24c5848b950f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:05Z,use_quota=True,user_id='e45528ed28644465b86edaa06bba17cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Creating volume 4e7b06cc-8aa0-4654-bbe5-5f069db72417 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:10:18 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:10:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:18 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 1073741824 Apr 24 17:10:18 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:18 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-fea17db0-0cb1-4d67-a8ea-43589071988d tempest-GroupsV314Test-2068339354 None] Create group from source-group-066c04d6-65d6-4a71-8118-af96dc74c8e0 completed successfully. Apr 24 17:10:19 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 1073741824" returned: 0 in 0.631s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:19 devstack sudo[87342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 Apr 24 17:10:19 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Acquiring lock "cinder-quobyte-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Lock "cinder-quobyte-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[065f8417-39c7-4893-bb76-03956786ebd4]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:19 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed Apr 24 17:10:19 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:19 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417" returned: 0 in 0.452s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.033s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1609981483',display_name='tempest-VolumesGetTest-Volume-1814889253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3e3e84-a5c8-4c55-b588-cda8decfe1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:07Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Creating volume 2e3e3e84-a5c8-4c55-b588-cda8decfe1f7 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:10:19 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:19 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7 1073741824 Apr 24 17:10:19 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db29cacc-26db-4766-91e6-acec78483b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a2d6f5-1ac1-4713-804f-4c2c15f3e66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:19 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Volume volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 (4e7b06cc-8aa0-4654-bbe5-5f069db72417): created successfully Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a2d6f5-1ac1-4713-804f-4c2c15f3e66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Flow 'volume_create_manager' (fe1ec5f7-dca2-4e5d-a962-12759019ce1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:19 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-13c710cd-14e5-42df-a2f0-0986f77b44df tempest-VolumesSnapshotTestJSON-1260785796 None] Created volume successfully. Apr 24 17:10:19 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed" returned: 0 in 0.560s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:19 devstack sudo[87352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed Apr 24 17:10:19 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:20 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7 1073741824" returned: 0 in 0.706s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:20 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed" returned: 0 in 0.529s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Lock "cinder-quobyte-7a7fa6fd-b1e2-4c33-a820-35e2ff91a5ed" released by "delete_volume" :: held 1.135s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:20 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7 Apr 24 17:10:20 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Created reservations ['53cc3e43-5382-441e-8056-c848f4f1e455'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:20 devstack cinder-volume[81986]: WARNING cinder.quota [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-147545034 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-147545034, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:10:20 devstack cinder-volume[81986]: WARNING cinder.quota [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-147545034 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-147545034, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Created reservations ['3b91a7c4-42c9-4add-9164-18e6ac4d51dc', '3a4abacd-107d-4729-9597-fb3554547e87', 'e52590ee-5984-4ce5-8514-e3dc77885373', '1c3efb18-326c-4a3f-99ec-1c5df63f4032'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:20 devstack sudo[87360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:20 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:21 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7" returned: 0 in 0.470s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.941s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-946364951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a76554-ee0c-4b85-8fd9-5afff96a4839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ad73dacf720452481f54f72b0dd3c3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:08Z,use_quota=True,user_id='a8098dba1b0f479d96bbeb05c0813fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Creating volume 05a76554-ee0c-4b85-8fd9-5afff96a4839 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:10:21 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb6d843-eb75-4e48-9b5d-434b562c9323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2dbe88-28d8-4c7a-abca-e3cdc543b5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:21 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839 1073741824 Apr 24 17:10:21 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:21 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Volume volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7 (2e3e3e84-a5c8-4c55-b588-cda8decfe1f7): created successfully Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2dbe88-28d8-4c7a-abca-e3cdc543b5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (ea0016a8-c82a-43e5-abe3-604ff690b620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:21 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e74fb763-b954-4479-b90d-e132bfaff5f1 tempest-VolumesGetTest-1722052253 None] Created volume successfully. Apr 24 17:10:21 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.462s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:21 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-635bc32f-7ef0-4ff4-8e3d-bd934ed43e57 tempest-GroupsV314Test-2068339354 None] Delete group completed successfully. Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Acquiring lock "cinder-quobyte-3ac74dd9-61d7-447f-9ebc-4fded6482a30" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Lock "cinder-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:21 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Lock "cinder-quobyte-3ac74dd9-61d7-447f-9ebc-4fded6482a30" acquired by "delete_volume" :: waited 0.036s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839 1073741824" returned: 0 in 0.715s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a463a65-7ec1-48b3-af24-8f5b7e3291a7]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-quobyte-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7" acquired by "delete_volume" :: waited 0.032s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:21 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839 Apr 24 17:10:21 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd02cb7a-1dcb-44e6-8271-602c5ea72c94]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:21 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 Apr 24 17:10:21 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:21 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7 Apr 24 17:10:21 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:22 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839" returned: 0 in 0.450s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.037s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] Creating offline snapshot 097d0734-cd15-4552-801d-a4b54444f8a9 of volume 4e7b06cc-8aa0-4654-bbe5-5f069db72417 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f475df4a-c414-4cdc-84aa-49bc3c9cb2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a76554-ee0c-4b85-8fd9-5afff96a4839', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17976a95-1825-4104-b04c-2df5843ceeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98f90d-a8ff-4e17-943c-c9d5046ea941]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:22 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Volume volume-05a76554-ee0c-4b85-8fd9-5afff96a4839 (05a76554-ee0c-4b85-8fd9-5afff96a4839): created successfully Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17976a95-1825-4104-b04c-2df5843ceeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Flow 'volume_create_manager' (60df6ab0-ecc2-419a-a0c0-1170a2551365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:22 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5631bec7-438a-4aea-8cd5-df1f7652e1eb tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Created volume successfully. Apr 24 17:10:22 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7" returned: 0 in 0.542s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:22 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30" returned: 0 in 0.621s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:22 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 Apr 24 17:10:22 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:22 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7 Apr 24 17:10:22 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:22 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30 Apr 24 17:10:22 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:22 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7" returned: 0 in 0.456s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7" released by "delete_volume" :: held 1.040s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:22 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ac74dd9-61d7-447f-9ebc-4fded6482a30" returned: 0 in 0.508s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Created reservations ['da4d30e0-f3e3-46e1-851d-b1f772c996a3', 'e75f4b7a-3182-40ca-93aa-2cd2702bc2ce', '2d2bb3f7-1ade-4911-b555-e3f0c3b7ad4f', '9e70013f-fa5e-42be-a133-c50e2c3943fa'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:22 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Lock "cinder-quobyte-3ac74dd9-61d7-447f-9ebc-4fded6482a30" released by "delete_volume" :: held 1.227s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417" returned: 0 in 0.628s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:23 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 1G Apr 24 17:10:23 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Created reservations ['27e6b94f-8a14-4c7e-867a-9416986981da'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:23 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:23 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Created reservations ['054ca967-f8d7-41b9-9e63-1c937e3b46ec', '32913b89-4e57-4c61-b80f-783698064739', '9a9e8c3b-5d2e-4812-8b2d-5596aa03f3d0', '663ce91a-a362-4146-b13e-503f58368f4b'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:23 devstack sudo[87397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:23 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:23 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 1G" returned: 0 in 0.625s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:23 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 Apr 24 17:10:23 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:23 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.615s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:23 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Deleted volume successfully. Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-009e6149-3235-40df-a430-2ff86b3128d4 tempest-VolumesGetTest-1722052253 None] Lock "cinder-2e3e3e84-a5c8-4c55-b588-cda8decfe1f7-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:23 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.572s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:23 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:23 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-98c0e14b-c459-40dc-8ae7-583f6e93b73c tempest-GroupsV314Test-2068339354 None] Delete group completed successfully. Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-116f1587-676b-4866-a8ec-a32fc7935196-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Lock "cinder-116f1587-676b-4866-a8ec-a32fc7935196-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Acquiring lock "cinder-05a76554-ee0c-4b85-8fd9-5afff96a4839-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-quobyte-116f1587-676b-4866-a8ec-a32fc7935196" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Lock "cinder-05a76554-ee0c-4b85-8fd9-5afff96a4839-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-116f1587-676b-4866-a8ec-a32fc7935196" acquired by "delete_volume" :: waited 0.060s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4fb5f1-c054-4fbe-b343-bbb48455a5cc]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:24 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Acquiring lock "cinder-quobyte-05a76554-ee0c-4b85-8fd9-5afff96a4839" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9" returned: 0 in 0.649s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:24 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 is being set with open permissions: ugo+rw Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Lock "cinder-quobyte-05a76554-ee0c-4b85-8fd9-5afff96a4839" acquired by "delete_volume" :: waited 0.033s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:24 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196 Apr 24 17:10:24 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:24 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 Apr 24 17:10:24 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5cf0a0-02b2-4da1-b3a4-9b8926640f27]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:24 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839 Apr 24 17:10:24 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:24 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9" returned: 0 in 0.578s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:24 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196" returned: 0 in 0.645s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:24 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196 Apr 24 17:10:24 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:24 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.info Apr 24 17:10:24 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:24 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839" returned: 0 in 0.640s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:24 devstack sudo[87426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839 Apr 24 17:10:24 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:25 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-116f1587-676b-4866-a8ec-a32fc7935196" returned: 0 in 0.554s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-116f1587-676b-4866-a8ec-a32fc7935196" released by "delete_volume" :: held 1.262s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Created reservations ['fe1f5ee6-2d09-4196-8471-396ab342b4ac', '2f62f523-6782-4584-93f9-f24e3ac0c328', 'ea86675a-22de-429e-bc10-00303ee5e5ff', '1909cfde-6bfe-4c1d-87f8-e11e2e8a3b1b'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:25 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:25 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:25 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.info" returned: 0 in 0.702s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:25 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.info is being set with open permissions: ugo+rw Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:25 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.info Apr 24 17:10:25 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:25 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-05a76554-ee0c-4b85-8fd9-5afff96a4839" returned: 0 in 0.727s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Lock "cinder-quobyte-05a76554-ee0c-4b85-8fd9-5afff96a4839" released by "delete_volume" :: held 1.426s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Created reservations ['e9351f7f-b33d-49a7-aff7-5e5c92afaeae', '4a89b748-e2dd-498c-bf94-0211d1e382c0', 'b50bffe1-6682-45bd-adfd-f79dbbefaeb9', '63ab3841-d8d7-49de-9016-e01ef1e4a818'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:25 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:25 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:26 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.info" returned: 0 in 0.583s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.916s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:26 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.760s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:26 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Deleted volume successfully. Apr 24 17:10:26 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ddf734d6-5199-43c8-9e5a-8f108a344bb0 tempest-VolumesSnapshotTestJSON-1260785796 None] Create snapshot completed successfully Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d193a07-f94f-49cc-abf7-5a6e9f6080ab tempest-VolumesGetTest-1722052253 None] Lock "cinder-116f1587-676b-4866-a8ec-a32fc7935196-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-45d053c1-f708-497a-bb36-a5ecd1cb77a9-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Lock "cinder-45d053c1-f708-497a-bb36-a5ecd1cb77a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:26 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.684s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-quobyte-45d053c1-f708-497a-bb36-a5ecd1cb77a9" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:26 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Deleted volume successfully. Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-45d053c1-f708-497a-bb36-a5ecd1cb77a9" acquired by "delete_volume" :: waited 0.027s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a157700d-00da-413b-95ae-e94dde7e442d tempest-VolumeQuotasNegativeTestJSON-1330439728 None] Lock "cinder-05a76554-ee0c-4b85-8fd9-5afff96a4839-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5538d66c-785b-4bad-a0cb-e43e8f7be452]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-097d0734-cd15-4552-801d-a4b54444f8a9-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:26 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 Apr 24 17:10:26 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-097d0734-cd15-4552-801d-a4b54444f8a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:UPDATE=206,cinder:DELETE=11,cinder:SELECT=158,cinder:INSERT=45 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-4e7b06cc-8aa0-4654-bbe5-5f069db72417" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-4e7b06cc-8aa0-4654-bbe5-5f069db72417" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-097d0734-cd15-4552-801d-a4b54444f8a9" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-097d0734-cd15-4552-801d-a4b54444f8a9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Deleting offline snapshot 097d0734-cd15-4552-801d-a4b54444f8a9 of volume 4e7b06cc-8aa0-4654-bbe5-5f069db72417 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] snapshot_file for this snap is: volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[224aa821-a973-49a3-a105-cba35f4c6232]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:27 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 Apr 24 17:10:27 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:27 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9" returned: 0 in 0.788s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:27 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9 Apr 24 17:10:27 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:27 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9" returned: 0 in 0.740s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:10:27 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c512003-978e-4dbe-ab45-ce8a8a9d1672]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:27 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 Apr 24 17:10:27 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:28 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-45d053c1-f708-497a-bb36-a5ecd1cb77a9" returned: 0 in 0.692s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-45d053c1-f708-497a-bb36-a5ecd1cb77a9" released by "delete_volume" :: held 1.562s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Created reservations ['4427eae4-321d-42a5-8159-0645132d3831', '543378d1-1008-41b0-8ce9-e387ce7deaf5', '02c62c24-71ed-40aa-9667-9f8c607d7f10', '6be085d9-6b06-411b-9a7c-12cd3ba7ea81'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:28 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:28 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:28 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417" returned: 0 in 0.692s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:28 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 Apr 24 17:10:28 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:28 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.559s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:28 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Deleted volume successfully. Apr 24 17:10:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-262c4fba-526a-4201-9821-13f01c3bea53 tempest-VolumesGetTest-1722052253 None] Lock "cinder-45d053c1-f708-497a-bb36-a5ecd1cb77a9-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:29 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9" returned: 0 in 0.784s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:29 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9 Apr 24 17:10:29 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (984acf55-c529-4410-b743-7bd2eb52a483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfe135c-a1cc-4bd7-8af1-781f3e73cce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfe135c-a1cc-4bd7-8af1-781f3e73cce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2084935348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1de5bfc-0962-43e0-85e7-ed878e554509,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:30Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99aa774a-be32-4437-98a0-db9f90343395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99aa774a-be32-4437-98a0-db9f90343395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d23512-c13b-4912-b821-1efb19f31586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.image.glance [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Creating Keystone auth plugin from conf {{(pid=81986) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Flow 'volume_create_manager' (527ed41d-0846-413c-8935-16ef29740c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8166bc0c-f9aa-4f3f-95d9-2fc83133daf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8166bc0c-f9aa-4f3f-95d9-2fc83133daf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1737948065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a5393b-b692-4908-86d7-ed6186190c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d998dcef209748b89e42eebd26f29254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:30Z,use_quota=True,user_id='d46050ccef5c405c95d499ea7797a776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122239df-54b8-4c73-a612-e85c2565fc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122239df-54b8-4c73-a612-e85c2565fc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3859a72-a23e-4cea-a489-fbc1539faf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3859a72-a23e-4cea-a489-fbc1539faf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a5393b-b692-4908-86d7-ed6186190c47', 'volume_name': 'volume-51a5393b-b692-4908-86d7-ed6186190c47', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647147db-eb97-4960-bd9b-fe3ddd0322de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647147db-eb97-4960-bd9b-fe3ddd0322de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f0fdc3-daee-4cd0-9187-f6e0959ca7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:29 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Volume 51a5393b-b692-4908-86d7-ed6186190c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a5393b-b692-4908-86d7-ed6186190c47', 'volume_size': 1} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1737948065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a5393b-b692-4908-86d7-ed6186190c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d998dcef209748b89e42eebd26f29254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:30Z,use_quota=True,user_id='d46050ccef5c405c95d499ea7797a776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Creating volume 51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:10:29 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:10:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:30 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:30 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 1073741824 Apr 24 17:10:30 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417.097d0734-cd15-4552-801d-a4b54444f8a9" returned: 0 in 0.801s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-097d0734-cd15-4552-801d-a4b54444f8a9" released by "_delete_snapshot" :: held 3.153s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-4e7b06cc-8aa0-4654-bbe5-5f069db72417" released by "delete_snapshot" :: held 3.185s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Created reservations ['c08102ab-9c04-49b5-b212-6fea16533c67', '5768fdf3-6d0e-4048-b5c1-35ec2fd2c72e', '6d855005-c94c-4a07-afe0-d432dfef037f', 'b82683d1-35d2-4e16-bc77-34bdc9eb9720'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:30 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Delete snapshot completed successfully. Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c16c502f-ac45-49b1-9ce3-b536d1252178 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-097d0734-cd15-4552-801d-a4b54444f8a9-delete_snapshot" released by "delete_snapshot" :: held 3.395s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d23512-c13b-4912-b821-1efb19f31586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1de5bfc-0962-43e0-85e7-ed878e554509', 'volume_name': 'volume-c1de5bfc-0962-43e0-85e7-ed878e554509', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63c9eee-8dec-4419-b4e9-52494652a4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63c9eee-8dec-4419-b4e9-52494652a4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce5a3d3-6ff0-4406-a3c9-d74001a327eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:30 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Volume c1de5bfc-0962-43e0-85e7-ed878e554509: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1de5bfc-0962-43e0-85e7-ed878e554509', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Trying to clone c1de5bfc-0962-43e0-85e7-ed878e554509 from image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]). {{(pid=81986) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 17:10:30 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Image download 20.69 MB at 20.69 MB/s Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[8872c307-2790-4d18-960b-c176a7101d63]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:30 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD Apr 24 17:10:30 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:30 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 1073741824" returned: 0 in 0.834s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:30 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 Apr 24 17:10:30 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:31 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD" returned: 0 in 0.544s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Temporary image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 is fetched for user 36e33c2830c5464ca9b86f2d6d76583c. {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a22cdd-4a1b-4726-a4ff-44f37b85480d]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:31 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD Apr 24 17:10:31 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:31 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47" returned: 0 in 0.573s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f0fdc3-daee-4cd0-9187-f6e0959ca7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a5393b-b692-4908-86d7-ed6186190c47', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337a881e-e78c-4629-86d8-307b787e1cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:31 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Volume volume-51a5393b-b692-4908-86d7-ed6186190c47 (51a5393b-b692-4908-86d7-ed6186190c47): created successfully Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337a881e-e78c-4629-86d8-307b787e1cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Flow 'volume_create_manager' (527ed41d-0846-413c-8935-16ef29740c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:31 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f1b39260-3cd5-4eda-88e5-f9d3c520bde1 tempest-SnapshotsActionsTest-2113282420 None] Created volume successfully. Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Flow 'volume_create_manager' (5840eb82-7aba-4e44-8964-bce8410059db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0b0a3d-e600-4597-a2dc-53d153288747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0b0a3d-e600-4597-a2dc-53d153288747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-323210638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48dcd190-a283-4d04-8e2a-066aa531367c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbfaf53b6e24b37a24c5848b950f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:32Z,use_quota=True,user_id='e45528ed28644465b86edaa06bba17cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0394ecd-fa13-4ee5-b762-4ebc1c46c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0394ecd-fa13-4ee5-b762-4ebc1c46c25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6f0980-0166-41f5-b408-bb5e0133a71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6f0980-0166-41f5-b408-bb5e0133a71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48dcd190-a283-4d04-8e2a-066aa531367c', 'volume_name': 'volume-48dcd190-a283-4d04-8e2a-066aa531367c', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf40e354-5245-41a4-bdb1-6626c11fbc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf40e354-5245-41a4-bdb1-6626c11fbc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524404d8-0e15-45d4-a4c4-872f95f5fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:31 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume 48dcd190-a283-4d04-8e2a-066aa531367c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48dcd190-a283-4d04-8e2a-066aa531367c', 'volume_size': 1} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-323210638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48dcd190-a283-4d04-8e2a-066aa531367c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbfaf53b6e24b37a24c5848b950f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:32Z,use_quota=True,user_id='e45528ed28644465b86edaa06bba17cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Creating volume 48dcd190-a283-4d04-8e2a-066aa531367c {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:10:31 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:31 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c 1073741824 Apr 24 17:10:31 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:31 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD" returned: 0 in 0.599s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Flow 'volume_create_manager' (70382a95-fef7-4fa5-8a08-259e545f4980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e195c8ff-6537-4ba6-b2c1-072f08a00b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e195c8ff-6537-4ba6-b2c1-072f08a00b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-200441142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3850b1f-36a7-4b14-99e1-e09e21e871c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ba9723ce2b40a19969dc65417ccd61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:32Z,use_quota=True,user_id='ccacf94a424646d2b7a062041bae6e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a5acadd-aab9-4ba6-b827-a1aefae53def),volume_type_id=1a5acadd-aab9-4ba6-b827-a1aefae53def)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2598648d-7248-4399-9d52-ffccb188ffcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2598648d-7248-4399-9d52-ffccb188ffcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf8b838-704b-4c07-80b6-33a52d54b0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf8b838-704b-4c07-80b6-33a52d54b0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3850b1f-36a7-4b14-99e1-e09e21e871c4', 'volume_name': 'volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3175a467-b48a-4f3e-bbee-6360a4fdee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3175a467-b48a-4f3e-bbee-6360a4fdee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bedc7f14-3e45-4452-a15f-0d7e6220caf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:32 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Volume e3850b1f-36a7-4b14-99e1-e09e21e871c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4', 'volume_size': 1} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:32 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c 1073741824" returned: 0 in 0.723s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:32 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c Apr 24 17:10:32 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:32 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c" returned: 0 in 0.446s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.927s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2084935348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1de5bfc-0962-43e0-85e7-ed878e554509,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:30Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Creating volume c1de5bfc-0962-43e0-85e7-ed878e554509 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:10:32 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:32 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 1073741824 Apr 24 17:10:32 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524404d8-0e15-45d4-a4c4-872f95f5fe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48dcd190-a283-4d04-8e2a-066aa531367c', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53f5ebc-dcc0-4eef-ad48-7468a795d1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:32 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume volume-48dcd190-a283-4d04-8e2a-066aa531367c (48dcd190-a283-4d04-8e2a-066aa531367c): created successfully Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53f5ebc-dcc0-4eef-ad48-7468a795d1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Flow 'volume_create_manager' (5840eb82-7aba-4e44-8964-bce8410059db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:32 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-4c32e06a-5f3a-47b7-8ce7-dc5e2c7b2bb1 tempest-VolumesSnapshotTestJSON-1260785796 None] Created volume successfully. Apr 24 17:10:33 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 1073741824" returned: 0 in 0.595s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:33 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 Apr 24 17:10:33 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:33 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509" returned: 0 in 0.459s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.830s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-200441142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3850b1f-36a7-4b14-99e1-e09e21e871c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ba9723ce2b40a19969dc65417ccd61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:32Z,use_quota=True,user_id='ccacf94a424646d2b7a062041bae6e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a5acadd-aab9-4ba6-b827-a1aefae53def),volume_type_id=1a5acadd-aab9-4ba6-b827-a1aefae53def)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Creating volume e3850b1f-36a7-4b14-99e1-e09e21e871c4 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:10:33 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:33 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4 1073741824 Apr 24 17:10:33 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:33 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Attempting download of 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}])) to volume c1de5bfc-0962-43e0-85e7-ed878e554509. {{(pid=81986) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 17:10:34 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[b894375a-4107-4e95-9f84-ab28e004f55c]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zkvse_yb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:34 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zkvse_yb Apr 24 17:10:34 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:34 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zkvse_yb" returned: 0 in 0.488s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zkvse_yb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:34 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4 1073741824" returned: 0 in 0.617s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:34 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zkvse_yb Apr 24 17:10:34 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:34 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4 Apr 24 17:10:34 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:35 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zkvse_yb" returned: 1 in 0.490s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_zkvse_yb' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cca059a-ce43-4b6c-95aa-d88231b44ac1]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:35 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4" returned: 0 in 0.449s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.857s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bedc7f14-3e45-4452-a15f-0d7e6220caf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac71583-816e-4430-a48e-8dcef2ed540f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:35 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD Apr 24 17:10:35 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:35 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Volume volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4 (e3850b1f-36a7-4b14-99e1-e09e21e871c4): created successfully Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac71583-816e-4430-a48e-8dcef2ed540f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Flow 'volume_create_manager' (70382a95-fef7-4fa5-8a08-259e545f4980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] Creating offline snapshot 12af1fe2-b417-4c38-8ad6-5a36624f2e66 of volume 51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:10:35 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-de0acbbe-a47c-4391-89df-0026aab57305 tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Created volume successfully. Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a30396-0059-454e-aa6b-7fc6d3759fc8]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:35 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 Apr 24 17:10:35 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:35 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 was qcow2, converting to raw {{(pid=81986) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:35 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 Apr 24 17:10:35 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4d3e04d6-1a95-44fe-81d3-a0793d96cf4a tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4d3e04d6-1a95-44fe-81d3-a0793d96cf4a tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e04d6-1a95-44fe-81d3-a0793d96cf4a tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4d3e04d6-1a95-44fe-81d3-a0793d96cf4a tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4d3e04d6-1a95-44fe-81d3-a0793d96cf4a tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4d3e04d6-1a95-44fe-81d3-a0793d96cf4a tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:35 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:35 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:35 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47" returned: 0 in 0.616s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:35 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 1G Apr 24 17:10:35 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:36 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4d3e04d6-1a95-44fe-81d3-a0793d96cf4a tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.565s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:36 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-4d3e04d6-1a95-44fe-81d3-a0793d96cf4a tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:36 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-4d3e04d6-1a95-44fe-81d3-a0793d96cf4a tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Retype volume completed successfully. Apr 24 17:10:36 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 1G" returned: 0 in 0.766s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:36 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:10:36 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Acquiring lock "cinder-e3850b1f-36a7-4b14-99e1-e09e21e871c4-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "cinder-e3850b1f-36a7-4b14-99e1-e09e21e871c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Acquiring lock "cinder-quobyte-e3850b1f-36a7-4b14-99e1-e09e21e871c4" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "cinder-quobyte-e3850b1f-36a7-4b14-99e1-e09e21e871c4" acquired by "delete_volume" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:36 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef99ec78-480b-4462-ac28-fc804e7fc758]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:37 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509" returned: 0 in 1.483s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_cr2nm1msdevstack@QuobyteHD, size 112.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:10:37 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Converted 112.00 MB image at 75.43 MB/s Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:37 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 1G Apr 24 17:10:37 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:37 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4 Apr 24 17:10:37 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:37 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.612s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:37 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 is being set with open permissions: ugo+rw Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:37 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:10:37 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:37 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 1G" returned: 0 in 0.507s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1a60a6-83cc-42fc-836f-7075602e145a]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:37 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:37 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.433s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4" returned: 0 in 0.592s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:37 devstack sudo[87573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4 Apr 24 17:10:37 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:37 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 Apr 24 17:10:37 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:37 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.info Apr 24 17:10:37 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:38 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3850b1f-36a7-4b14-99e1-e09e21e871c4" returned: 0 in 0.456s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "cinder-quobyte-e3850b1f-36a7-4b14-99e1-e09e21e871c4" released by "delete_volume" :: held 1.100s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:38 devstack cinder-volume[81986]: WARNING cinder.quota [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:10:38 devstack cinder-volume[81986]: WARNING cinder.quota [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 17:10:38 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.info" returned: 0 in 0.474s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:38 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.info is being set with open permissions: ugo+rw Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:38 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Created reservations ['f27132bd-7837-4bba-b627-09a17f211e35', '6b2aae4a-472b-4d78-95a5-534e2c43420a', 'a3e3c2f2-118c-4bf8-8f04-71702a7b9443', '5f4a0f83-41c0-40d8-9aa6-a0c63e11a43a'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:38 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.info Apr 24 17:10:38 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509" returned: 0 in 0.575s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:38 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 Apr 24 17:10:38 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:38 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:38 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:38 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.info" returned: 0 in 0.423s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.481s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.708s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] Creating offline snapshot c7228393-923e-4c62-bd15-b49a6eb0a3d1 of volume 48dcd190-a283-4d04-8e2a-066aa531367c {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d26fb3f-ab5a-40cc-a25b-bd4c048a76ff]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:38 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a20eb756-b639-433c-a6f1-41dfa4f9e29a tempest-SnapshotsActionsTest-2113282420 None] Create snapshot completed successfully Apr 24 17:10:38 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c Apr 24 17:10:38 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:38 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.477s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:38 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Deleted volume successfully. Apr 24 17:10:38 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509" returned: 1 in 0.578s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Downloaded image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}])) to volume c1de5bfc-0962-43e0-85e7-ed878e554509 successfully. {{(pid=81986) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Temporary image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 for user 36e33c2830c5464ca9b86f2d6d76583c is deleted. {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Marking volume c1de5bfc-0962-43e0-85e7-ed878e554509 as bootable. {{(pid=81986) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-93e08108-505f-4898-b24e-ac689034f27d tempest-VolumeRetypeWithoutMigrationTest-1153201305 None] Lock "cinder-e3850b1f-36a7-4b14-99e1-e09e21e871c4-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Copying metadata from image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 to c1de5bfc-0962-43e0-85e7-ed878e554509. {{(pid=81986) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Creating volume glance metadata for volume c1de5bfc-0962-43e0-85e7-ed878e554509 backed by image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81986) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce5a3d3-6ff0-4406-a3c9-d74001a327eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1de5bfc-0962-43e0-85e7-ed878e554509', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379b7d29-e04f-4785-9a6a-a61e759826e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:38 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Volume volume-c1de5bfc-0962-43e0-85e7-ed878e554509 (c1de5bfc-0962-43e0-85e7-ed878e554509): created successfully Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379b7d29-e04f-4785-9a6a-a61e759826e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:38 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (984acf55-c529-4410-b743-7bd2eb52a483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:38 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-daa622bb-0f80-4ce5-9920-828bcfa789bb tempest-VolumesGetTest-1722052253 None] Created volume successfully. Apr 24 17:10:39 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c" returned: 0 in 0.571s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:39 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 1G Apr 24 17:10:39 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:39 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 1G" returned: 0 in 0.698s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48dcd190-a283-4d04-8e2a-066aa531367c -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:39 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48dcd190-a283-4d04-8e2a-066aa531367c -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 Apr 24 17:10:39 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (a9ff0453-0aa5-44c3-bd94-02efbfb60e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7197ff4-e491-4999-aee1-ea318605b9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7197ff4-e491-4999-aee1-ea318605b9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1064949961',display_name='tempest-VolumesGetTest-Volume-1336279703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5e03c5-8b4e-4abd-a9a1-591272e20b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:40Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eef7fcc-bc22-44a1-b8a7-732fce3a7e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eef7fcc-bc22-44a1-b8a7-732fce3a7e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b3930b-093a-4573-b38b-ee4f76a9134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b3930b-093a-4573-b38b-ee4f76a9134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b5e03c5-8b4e-4abd-a9a1-591272e20b8a', 'volume_name': 'volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0e5119-f83f-4fb3-8406-161a2812f1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0e5119-f83f-4fb3-8406-161a2812f1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c8d6db-196f-4a50-b6f6-881918b2bc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:40 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Volume 5b5e03c5-8b4e-4abd-a9a1-591272e20b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a', 'volume_size': 1} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:40 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48dcd190-a283-4d04-8e2a-066aa531367c -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1" returned: 0 in 0.729s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:40 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 is being set with open permissions: ugo+rw Apr 24 17:10:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:40 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 Apr 24 17:10:40 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:41 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1" returned: 0 in 0.531s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:41 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.info Apr 24 17:10:41 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:41 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.info" returned: 0 in 0.499s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:41 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.info is being set with open permissions: ugo+rw Apr 24 17:10:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:41 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.info Apr 24 17:10:41 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:42 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.info" returned: 0 in 0.498s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.622s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.035s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1064949961',display_name='tempest-VolumesGetTest-Volume-1336279703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5e03c5-8b4e-4abd-a9a1-591272e20b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0eb2c5c3194a1c8bf121f3412fca93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:40Z,use_quota=True,user_id='36e33c2830c5464ca9b86f2d6d76583c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Creating volume 5b5e03c5-8b4e-4abd-a9a1-591272e20b8a {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:10:42 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:42 devstack sudo[87620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a 1073741824 Apr 24 17:10:42 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:42 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-6785768c-b03a-46c9-ae89-4df5bf36a38e tempest-VolumesSnapshotTestJSON-1260785796 None] Create snapshot completed successfully Apr 24 17:10:42 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a 1073741824" returned: 0 in 0.669s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:42 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a Apr 24 17:10:42 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:43 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a" returned: 0 in 0.541s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.187s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] Creating offline snapshot 747fa838-2835-4cae-b984-70d6d4c67ac2 of volume 51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c8d6db-196f-4a50-b6f6-881918b2bc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef42695b-6415-4b49-ac17-c9b43852f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f57e5db-73fd-4fda-8d69-95ee9ece2822]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:43 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Volume volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a (5b5e03c5-8b4e-4abd-a9a1-591272e20b8a): created successfully Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef42695b-6415-4b49-ac17-c9b43852f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Flow 'volume_create_manager' (a9ff0453-0aa5-44c3-bd94-02efbfb60e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:43 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-99383f44-f9a1-469c-a39e-4dd21c134a4e tempest-VolumesGetTest-1722052253 None] Created volume successfully. Apr 24 17:10:43 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:10:43 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Flow 'volume_create_manager' (6547c98d-b693-42f5-a050-5ff1d4f121bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488609fe-a245-47e1-a9c6-8e5452e9c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488609fe-a245-47e1-a9c6-8e5452e9c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1969078055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee98f13c-bdfa-4650-87c1-19dc0fc22ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbfaf53b6e24b37a24c5848b950f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c7228393-923e-4c62-bd15-b49a6eb0a3d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:44Z,use_quota=True,user_id='e45528ed28644465b86edaa06bba17cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2370f200-5839-4e67-88a9-eef4702aaea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2370f200-5839-4e67-88a9-eef4702aaea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a1c0e4-4404-4a7e-b17c-23802d41624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a1c0e4-4404-4a7e-b17c-23802d41624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee98f13c-bdfa-4650-87c1-19dc0fc22ac4', 'volume_name': 'volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4', 'volume_size': 2, 'snapshot_id': 'c7228393-923e-4c62-bd15-b49a6eb0a3d1'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dac9de-5530-48a5-b93b-97c890642a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dac9de-5530-48a5-b93b-97c890642a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9356d1fb-7763-4255-926d-cf5222b159b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:43 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume ee98f13c-bdfa-4650-87c1-19dc0fc22ac4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4', 'volume_size': 2, 'snapshot_id': 'c7228393-923e-4c62-bd15-b49a6eb0a3d1'} Apr 24 17:10:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:44 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.616s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:44 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 1G Apr 24 17:10:44 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Flow 'volume_create_manager' (9e215524-da89-4e80-b69b-0cfe1dedde6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974a4c1b-d4c3-4e9c-a4b0-d7dbdae508e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974a4c1b-d4c3-4e9c-a4b0-d7dbdae508e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-988840141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546d41fb-d79c-443f-8f7a-11b4852b143e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32d8c3960b342c3b2dbb98eb92a2f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:44Z,use_quota=True,user_id='d5bee186020e4ae8b49abd49cc5cd1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4782aa7b-2664-4369-904d-a93beb7547e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4782aa7b-2664-4369-904d-a93beb7547e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e04d04-0437-410c-9c54-07bc4146a77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e04d04-0437-410c-9c54-07bc4146a77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '546d41fb-d79c-443f-8f7a-11b4852b143e', 'volume_name': 'volume-546d41fb-d79c-443f-8f7a-11b4852b143e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46fc529-05a7-40fb-90f9-fef0669680fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46fc529-05a7-40fb-90f9-fef0669680fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f86e56-c034-4ae0-bd75-dc181500d379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:44 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Volume 546d41fb-d79c-443f-8f7a-11b4852b143e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-546d41fb-d79c-443f-8f7a-11b4852b143e', 'volume_size': 1} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Lock "cinder-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-quobyte-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[be28f72c-1f1a-470d-ac1e-1b8795eea005]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:44 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a Apr 24 17:10:44 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:44 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 1G" returned: 0 in 0.677s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:44 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 Apr 24 17:10:44 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:45 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a" returned: 0 in 0.527s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:45 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a Apr 24 17:10:45 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:45 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2" returned: 0 in 0.520s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:45 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 is being set with open permissions: ugo+rw Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:45 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 Apr 24 17:10:45 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:45 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a" returned: 0 in 0.455s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a" released by "delete_volume" :: held 1.023s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Created reservations ['20bc938c-16b5-4861-9de0-ba92017e91f6', '75f71ea5-b5d1-4ce1-b3e0-4b28d171c37b', '71ccb5ce-6a50-4d33-ae20-590a5f94acaf', 'd15f77b1-9b5c-41a6-8aab-94dd88152f4f'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:45 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:45 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:45 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2" returned: 0 in 0.534s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.077s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-c7228393-923e-4c62-bd15-b49a6eb0a3d1-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" by "_create_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-c7228393-923e-4c62-bd15-b49a6eb0a3d1-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Creating volume ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 from snapshot c7228393-923e-4c62-bd15-b49a6eb0a3d1 {{(pid=81986) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] snapshot: c7228393-923e-4c62-bd15-b49a6eb0a3d1, volume: ee98f13c-bdfa-4650-87c1-19dc0fc22ac4, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:10:45 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-148ce4ca-d608-43ab-a052-2f5e0137da90 tempest-SnapshotsActionsTest-2113282420 None] Create snapshot completed successfully Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d3dbdd-e031-41a4-a943-6ecc43f9b399]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:46 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 Apr 24 17:10:46 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:46 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.464s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:46 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Deleted volume successfully. Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f8944389-bd7f-4a05-b29c-12069aa88944 tempest-VolumesGetTest-1722052253 None] Lock "cinder-5b5e03c5-8b4e-4abd-a9a1-591272e20b8a-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:46 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1" returned: 0 in 0.541s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48dcd190-a283-4d04-8e2a-066aa531367c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[402307bb-140e-484e-8609-4e7793572d89]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-747fa838-2835-4cae-b984-70d6d4c67ac2-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-747fa838-2835-4cae-b984-70d6d4c67ac2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-quobyte-747fa838-2835-4cae-b984-70d6d4c67ac2" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:46 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c Apr 24 17:10:46 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-747fa838-2835-4cae-b984-70d6d4c67ac2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Deleting offline snapshot 747fa838-2835-4cae-b984-70d6d4c67ac2 of volume 51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] snapshot_file for this snap is: volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[3619e6fe-9f3c-417c-be38-702ec95a7b8b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:46 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 Apr 24 17:10:46 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-c1de5bfc-0962-43e0-85e7-ed878e554509-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Lock "cinder-c1de5bfc-0962-43e0-85e7-ed878e554509-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Acquiring lock "cinder-quobyte-c1de5bfc-0962-43e0-85e7-ed878e554509" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-c1de5bfc-0962-43e0-85e7-ed878e554509" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[343bd827-621f-474d-bc2d-27259147a0ed]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:47 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 Apr 24 17:10:47 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:47 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c" returned: 0 in 0.614s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:47 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 Apr 24 17:10:47 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:47 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2" returned: 0 in 0.528s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f81c3d8-6b61-44d7-8605-bf77f01c8eb0]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:47 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:10:47 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:47 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509" returned: 0 in 0.541s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:47 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 Apr 24 17:10:47 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:47 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.572s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:10:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:47 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 Apr 24 17:10:47 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:48 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509" returned: 1 in 1.107s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:10:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:48 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509 Apr 24 17:10:48 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:49 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2" returned: 0 in 1.191s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:49 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2 Apr 24 17:10:49 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:49 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c1de5bfc-0962-43e0-85e7-ed878e554509" returned: 0 in 1.288s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:49 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Lock "cinder-quobyte-c1de5bfc-0962-43e0-85e7-ed878e554509" released by "delete_volume" :: held 3.000s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Created reservations ['5fc01b95-6857-4552-ae23-c2e4391ed5f1', 'b6e180d4-08dd-4abc-9cc4-797ad986179e', 'bc81b466-7fd8-486d-9de8-cc97665378bc', '658d061b-0cfb-4410-a6d0-046c24c16498'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:50 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:50 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:50 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.747fa838-2835-4cae-b984-70d6d4c67ac2" returned: 0 in 1.214s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-747fa838-2835-4cae-b984-70d6d4c67ac2" released by "_delete_snapshot" :: held 3.649s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" released by "delete_snapshot" :: held 3.681s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Created reservations ['71a19289-407e-4990-b845-855ff8722c14', '1b3fd62d-6587-47d2-9b9d-972d54113008', '4ebbae9c-3845-4d7f-a76d-a3116f59b05d', '6a09d226-77f3-4f7d-bdd0-1b7de9162198'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:50 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Delete snapshot completed successfully. Apr 24 17:10:50 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3e1ec1d1-1703-4104-bacc-b7fbb2291c32 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-747fa838-2835-4cae-b984-70d6d4c67ac2-delete_snapshot" released by "delete_snapshot" :: held 4.040s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:51 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 1.600s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:51 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:51 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Deleted volume successfully. Apr 24 17:10:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ca4127d8-f871-4181-aec3-34796486d2ca tempest-VolumesGetTest-1722052253 None] Lock "cinder-c1de5bfc-0962-43e0-85e7-ed878e554509-delete_volume" released by "delete_volume" :: held 4.957s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:53 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" returned: 0 in 5.792s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:53 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e5eafe-6b01-4786-92fa-9702619bc169]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:53 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c Apr 24 17:10:53 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:53 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c" returned: 0 in 0.716s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:53 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:10:53 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Converted 1024.00 MB image at 176.75 MB/s Apr 24 17:10:53 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 is being set with open permissions: ugo+rw Apr 24 17:10:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:53 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 Apr 24 17:10:53 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:54 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" returned: 0 in 0.466s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" released by "_copy_volume_from_snapshot" :: held 8.231s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-c7228393-923e-4c62-bd15-b49a6eb0a3d1-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" released by "_create_volume_from_snapshot" :: held 8.270s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.297s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.774s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-988840141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546d41fb-d79c-443f-8f7a-11b4852b143e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32d8c3960b342c3b2dbb98eb92a2f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:44Z,use_quota=True,user_id='d5bee186020e4ae8b49abd49cc5cd1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Creating volume 546d41fb-d79c-443f-8f7a-11b4852b143e {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:10:54 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:54 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e 1073741824 Apr 24 17:10:54 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9356d1fb-7763-4255-926d-cf5222b159b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4', 'volume_size': 2, 'snapshot_id': 'c7228393-923e-4c62-bd15-b49a6eb0a3d1'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bc330a-0da3-4d4d-9da8-2a6f5c6c6c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:54 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 (ee98f13c-bdfa-4650-87c1-19dc0fc22ac4): created successfully Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bc330a-0da3-4d4d-9da8-2a6f5c6c6c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Flow 'volume_create_manager' (6547c98d-b693-42f5-a050-5ff1d4f121bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:54 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-25293696-f910-4463-957e-a0d11d2ef311 tempest-VolumesSnapshotTestJSON-1260785796 None] Created volume successfully. Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Flow 'volume_create_manager' (833bcf43-05f6-4f01-a76a-94a6f0e5675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2443c21-fcad-4440-8f03-9396760502ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2443c21-fcad-4440-8f03-9396760502ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-494776974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22179e3a-b530-4075-9f09-933fad026943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26cae20153fe45ca9f7b3a91bba8ed14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:54Z,use_quota=True,user_id='cfabd9bd7bfd49b8a5f6cd1dbd639c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4267ec-ef15-4ccc-ab98-84a0b13981d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4267ec-ef15-4ccc-ab98-84a0b13981d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa1b188-afd0-4bdc-95f2-a58c970ff195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa1b188-afd0-4bdc-95f2-a58c970ff195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22179e3a-b530-4075-9f09-933fad026943', 'volume_name': 'volume-22179e3a-b530-4075-9f09-933fad026943', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0af1ef-b5f0-4191-a707-b7e3662820b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0af1ef-b5f0-4191-a707-b7e3662820b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e1025b-290f-4a23-8418-e00c20c96bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:54 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Volume 22179e3a-b530-4075-9f09-933fad026943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22179e3a-b530-4075-9f09-933fad026943', 'volume_size': 1} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:54 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e 1073741824" returned: 0 in 0.677s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" acquired by "delete_volume" :: waited 0.032s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:54 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e Apr 24 17:10:54 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a996463-df91-4cac-a9cf-629edd15b3d2]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:55 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 Apr 24 17:10:55 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:55 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e" returned: 0 in 0.451s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.824s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f86e56-c034-4ae0-bd75-dc181500d379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-546d41fb-d79c-443f-8f7a-11b4852b143e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77aa4d37-f93a-4fd1-8959-217dc17973dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] Creating offline snapshot 130458bb-1016-4e39-b394-119b9afe9295 of volume 51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:10:55 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Volume volume-546d41fb-d79c-443f-8f7a-11b4852b143e (546d41fb-d79c-443f-8f7a-11b4852b143e): created successfully Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77aa4d37-f93a-4fd1-8959-217dc17973dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Flow 'volume_create_manager' (9e215524-da89-4e80-b69b-0cfe1dedde6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[549b7bee-8ade-4fdd-b18e-06acc03691ac]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:55 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-c274507b-6bec-4ad3-a040-cf968723576a tempest-VolumesServicesTestJSON-1118708682 None] Created volume successfully. Apr 24 17:10:55 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" returned: 0 in 0.580s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:55 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4 Apr 24 17:10:55 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:55 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:10:55 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:56 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" returned: 0 in 0.475s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:56 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.553s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4" released by "delete_volume" :: held 1.109s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:56 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 1G Apr 24 17:10:56 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Created reservations ['3ef78d7e-77d5-4a2a-9d6d-cfeea34af745', '12ede72b-667d-44bb-97c8-62b238dfc741', 'af71ac37-7c29-49f5-8515-e7277cddece4', '2b098754-d094-43a4-8243-0c15d0df4619'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:56 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:56 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Acquiring lock "cinder-546d41fb-d79c-443f-8f7a-11b4852b143e-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Lock "cinder-546d41fb-d79c-443f-8f7a-11b4852b143e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Acquiring lock "cinder-quobyte-546d41fb-d79c-443f-8f7a-11b4852b143e" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Lock "cinder-quobyte-546d41fb-d79c-443f-8f7a-11b4852b143e" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b929026-7a46-4822-86c0-cdc6aeb166fa]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:56 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e Apr 24 17:10:56 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:56 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.549s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:56 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Deleted volume successfully. Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df67f433-340c-4454-85e7-b4562329a813 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-ee98f13c-bdfa-4650-87c1-19dc0fc22ac4-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:56 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 1G" returned: 0 in 0.761s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:56 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 Apr 24 17:10:56 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-c7228393-923e-4c62-bd15-b49a6eb0a3d1-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-c7228393-923e-4c62-bd15-b49a6eb0a3d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-48dcd190-a283-4d04-8e2a-066aa531367c" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-48dcd190-a283-4d04-8e2a-066aa531367c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-c7228393-923e-4c62-bd15-b49a6eb0a3d1" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-c7228393-923e-4c62-bd15-b49a6eb0a3d1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:57 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Deleting offline snapshot c7228393-923e-4c62-bd15-b49a6eb0a3d1 of volume 48dcd190-a283-4d04-8e2a-066aa531367c {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] snapshot_file for this snap is: volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e" returned: 0 in 0.616s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[247d09f8-59d3-48a2-9665-a1d3f9d6be84]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:57 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e Apr 24 17:10:57 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:57 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 Apr 24 17:10:57 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:57 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295" returned: 0 in 0.543s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:57 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 is being set with open permissions: ugo+rw Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:57 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 Apr 24 17:10:57 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:57 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-546d41fb-d79c-443f-8f7a-11b4852b143e" returned: 0 in 0.473s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Lock "cinder-quobyte-546d41fb-d79c-443f-8f7a-11b4852b143e" released by "delete_volume" :: held 1.137s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Created reservations ['3c9141f1-4f58-4930-b44a-28e27c8be25a', '7224b485-b2ee-4655-9b19-941dff5e9063', 'b8df41fb-b811-4403-bda1-21cfdf77f7c4', '1561db66-0855-4992-a689-f6d1d94a75b3'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:57 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295" returned: 0 in 0.436s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:57 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:57 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:10:57 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.364s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-494776974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22179e3a-b530-4075-9f09-933fad026943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26cae20153fe45ca9f7b3a91bba8ed14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:10:54Z,use_quota=True,user_id='cfabd9bd7bfd49b8a5f6cd1dbd639c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Creating volume 22179e3a-b530-4075-9f09-933fad026943 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:10:57 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1" returned: 0 in 0.661s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48dcd190-a283-4d04-8e2a-066aa531367c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:10:57 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943 1073741824 Apr 24 17:10:57 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffafdb15-c41e-49a9-8f49-675b8ab6a7a9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:57 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-8ecf5b79-f55f-4143-a5c3-f291a683a915 tempest-SnapshotsActionsTest-2113282420 None] Create snapshot completed successfully Apr 24 17:10:58 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c Apr 24 17:10:58 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:58 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.484s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:10:58 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Deleted volume successfully. Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-36cf23cb-093b-471a-8445-38760f58ec1a tempest-VolumesServicesTestJSON-1118708682 None] Lock "cinder-546d41fb-d79c-443f-8f7a-11b4852b143e-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:58 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c" returned: 0 in 0.622s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:58 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 Apr 24 17:10:58 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:58 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943 1073741824" returned: 0 in 0.698s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:58 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943 Apr 24 17:10:58 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-130458bb-1016-4e39-b394-119b9afe9295-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-130458bb-1016-4e39-b394-119b9afe9295-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-quobyte-130458bb-1016-4e39-b394-119b9afe9295" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-130458bb-1016-4e39-b394-119b9afe9295" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Deleting offline snapshot 130458bb-1016-4e39-b394-119b9afe9295 of volume 51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:10:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] snapshot_file for this snap is: volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[205e2997-f9f7-46f6-b3e7-68595cc78652]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:59 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 Apr 24 17:10:59 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:59 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1" returned: 0 in 0.602s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:59 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1 Apr 24 17:10:59 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:59 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943" returned: 0 in 0.615s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e1025b-290f-4a23-8418-e00c20c96bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22179e3a-b530-4075-9f09-933fad026943', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f591d83-92a0-49c0-bc13-576d7cb07327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:10:59 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Volume volume-22179e3a-b530-4075-9f09-933fad026943 (22179e3a-b530-4075-9f09-933fad026943): created successfully Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f591d83-92a0-49c0-bc13-576d7cb07327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Flow 'volume_create_manager' (833bcf43-05f6-4f01-a76a-94a6f0e5675b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:10:59 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f64c32c8-11f8-431e-ae7e-2794ae8b3ee6 tempest-VolumesNegativeTest-174520109 None] Created volume successfully. Apr 24 17:10:59 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295" returned: 0 in 0.620s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15214d7-8e61-450c-b6a9-735978950c67]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:10:59 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c.c7228393-923e-4c62-bd15-b49a6eb0a3d1" returned: 0 in 0.524s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:10:59 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:10:59 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-c7228393-923e-4c62-bd15-b49a6eb0a3d1" released by "_delete_snapshot" :: held 2.546s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-48dcd190-a283-4d04-8e2a-066aa531367c" released by "delete_snapshot" :: held 2.576s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Created reservations ['84da6363-98a9-4f7b-8729-e6276d9e4b39', '8f280e22-b84f-4450-af03-250363c89dc3', '6209d5c2-aa7b-47e4-86fd-8f663d956323', '6dfac335-2faf-4871-bfd8-415454ede61a'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:10:59 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Delete snapshot completed successfully. Apr 24 17:10:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9c3ff646-c983-4dd2-903e-90e30df2534d tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-c7228393-923e-4c62-bd15-b49a6eb0a3d1-delete_snapshot" released by "delete_snapshot" :: held 2.736s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:00 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.759s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:00 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 Apr 24 17:11:00 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-48dcd190-a283-4d04-8e2a-066aa531367c-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-48dcd190-a283-4d04-8e2a-066aa531367c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-48dcd190-a283-4d04-8e2a-066aa531367c" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-48dcd190-a283-4d04-8e2a-066aa531367c" acquired by "delete_volume" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:00 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8adfba-44ec-4a57-b4d3-ae665cbeb410]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:00 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c Apr 24 17:11:00 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:01 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295" returned: 0 in 0.878s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:01 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295 Apr 24 17:11:01 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:01 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c" returned: 0 in 0.794s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:01 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c Apr 24 17:11:01 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:01 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.130458bb-1016-4e39-b394-119b9afe9295" returned: 0 in 0.597s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-130458bb-1016-4e39-b394-119b9afe9295" released by "_delete_snapshot" :: held 2.962s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" released by "delete_snapshot" :: held 2.991s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Created reservations ['17e90b20-4632-4a07-841f-af1eae746180', '8f041b14-f3e0-46df-ab47-6fbe9a4b65e2', 'afd78c97-8933-4c5f-aa6c-7a521d530c4b', 'ffe6c993-971b-4cd1-bf27-9504941c9a1d'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:02 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Delete snapshot completed successfully. Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e22bc40-0c43-406a-9bce-98aec524d8b2 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-130458bb-1016-4e39-b394-119b9afe9295-delete_snapshot" released by "delete_snapshot" :: held 3.188s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:02 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-48dcd190-a283-4d04-8e2a-066aa531367c" returned: 0 in 0.620s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-48dcd190-a283-4d04-8e2a-066aa531367c" released by "delete_volume" :: held 1.484s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Created reservations ['ed20defe-2deb-4d89-93b0-969b82c883c6', '27672fb9-0f16-4fe2-bac1-22f78c5be767', '6166a316-160a-42f6-bef6-83df5c094c93', 'dc2a5021-fa71-474e-8f41-448e0ba9dd1e'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:02 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:11:02 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] Creating offline snapshot 4a4b1e28-2114-4364-9292-79f5a32d197c of volume 51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[035d3076-d6fa-4ea6-baee-8fd21b46e257]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:02 devstack sudo[87863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:11:02 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:02 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.614s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:11:02 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Deleted volume successfully. Apr 24 17:11:02 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:11:02 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08d16048-7229-4df9-a971-bcb280e18783 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-48dcd190-a283-4d04-8e2a-066aa531367c-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:03 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.685s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:03 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c 1G Apr 24 17:11:03 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Flow 'volume_create_manager' (2f15f7ea-026b-4e0c-a6c4-5977117df08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca261be9-9773-4814-83c2-a46cb0c0d21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca261be9-9773-4814-83c2-a46cb0c0d21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-954590728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689c7a9e-2c88-47ad-a222-7f9f0c977297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbfaf53b6e24b37a24c5848b950f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:03Z,use_quota=True,user_id='e45528ed28644465b86edaa06bba17cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f9253c-c6f4-4d0f-b127-c238d92f4b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f9253c-c6f4-4d0f-b127-c238d92f4b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb629eb-a8b7-4857-8dca-c70ca0146429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb629eb-a8b7-4857-8dca-c70ca0146429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '689c7a9e-2c88-47ad-a222-7f9f0c977297', 'volume_name': 'volume-689c7a9e-2c88-47ad-a222-7f9f0c977297', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12380061-b28a-49f9-b223-a90cb2036ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12380061-b28a-49f9-b223-a90cb2036ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35a3a62-87ad-4ea3-a72f-ab0e5803a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:03 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume 689c7a9e-2c88-47ad-a222-7f9f0c977297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-689c7a9e-2c88-47ad-a222-7f9f0c977297', 'volume_size': 1} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:03 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.713s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:11:04 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c 1G" returned: 0 in 0.800s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:04 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c Apr 24 17:11:04 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Flow 'volume_create_manager' (b1388301-05e4-4832-bc49-1caf54696801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:04 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de1e79e-ae5e-4f35-a802-7468debac941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c" returned: 0 in 0.597s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:04 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c is being set with open permissions: ugo+rw Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:04 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c Apr 24 17:11:04 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de1e79e-ae5e-4f35-a802-7468debac941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1771646311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3ac988-8773-48c6-b57a-9b13dc1eb2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352f3960abcb46f8b9016b08f18ee207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:05Z,use_quota=True,user_id='38b063d163d541cc84930861fa2db2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31379cad-efe4-4fc5-8c69-6d2b8b35eb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31379cad-efe4-4fc5-8c69-6d2b8b35eb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461c3e62-4f0d-4e55-856f-4951b925ec57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461c3e62-4f0d-4e55-856f-4951b925ec57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3ac988-8773-48c6-b57a-9b13dc1eb2fb', 'volume_name': 'volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaf3b26-b877-4bfa-a0ea-ab6e1f2dd705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaf3b26-b877-4bfa-a0ea-ab6e1f2dd705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69cbf5f5-646c-4c10-b1dc-f6c53692f2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:04 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Volume 5b3ac988-8773-48c6-b57a-9b13dc1eb2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb', 'volume_size': 1} Apr 24 17:11:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:05 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c" returned: 0 in 0.436s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.611s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-954590728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689c7a9e-2c88-47ad-a222-7f9f0c977297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbfaf53b6e24b37a24c5848b950f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:03Z,use_quota=True,user_id='e45528ed28644465b86edaa06bba17cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Creating volume 689c7a9e-2c88-47ad-a222-7f9f0c977297 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:11:05 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:05 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 1073741824 Apr 24 17:11:05 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:05 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2b39f72c-041a-4461-adf6-81867cf09474 tempest-SnapshotsActionsTest-2113282420 None] Create snapshot completed successfully Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-4a4b1e28-2114-4364-9292-79f5a32d197c-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-4a4b1e28-2114-4364-9292-79f5a32d197c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-quobyte-4a4b1e28-2114-4364-9292-79f5a32d197c" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-4a4b1e28-2114-4364-9292-79f5a32d197c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Deleting offline snapshot 4a4b1e28-2114-4364-9292-79f5a32d197c of volume 51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] snapshot_file for this snap is: volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:11:05 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 1073741824" returned: 0 in 0.724s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c10162-ea2b-43d9-b36f-c2fef09e4203]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:05 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 Apr 24 17:11:05 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:05 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c Apr 24 17:11:05 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:06 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297" returned: 0 in 0.489s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1771646311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3ac988-8773-48c6-b57a-9b13dc1eb2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352f3960abcb46f8b9016b08f18ee207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:05Z,use_quota=True,user_id='38b063d163d541cc84930861fa2db2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Creating volume 5b3ac988-8773-48c6-b57a-9b13dc1eb2fb {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:11:06 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35a3a62-87ad-4ea3-a72f-ab0e5803a913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689c7a9e-2c88-47ad-a222-7f9f0c977297', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d31534-150e-47d8-ba72-c245a415537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:06 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb 1073741824 Apr 24 17:11:06 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:06 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 (689c7a9e-2c88-47ad-a222-7f9f0c977297): created successfully Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d31534-150e-47d8-ba72-c245a415537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Flow 'volume_create_manager' (2f15f7ea-026b-4e0c-a6c4-5977117df08c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:06 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-17fe0fc5-127b-43e2-93a6-4d0bbe62c742 tempest-VolumesSnapshotTestJSON-1260785796 None] Created volume successfully. Apr 24 17:11:06 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c" returned: 0 in 0.709s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f138e9c9-cb94-4e0d-bf4f-f45bef1cba04]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:06 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:11:06 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:07 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb 1073741824" returned: 0 in 0.916s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:07 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb Apr 24 17:11:07 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:07 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.909s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:07 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:07 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c Apr 24 17:11:07 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:07 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb" returned: 0 in 0.626s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:07 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:11:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.116s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] Creating offline snapshot 1ebc14da-4991-45cb-9fca-a0e5add03a12 of volume 689c7a9e-2c88-47ad-a222-7f9f0c977297 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69cbf5f5-646c-4c10-b1dc-f6c53692f2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3a48c6-389d-4c88-a8e5-fa878e119f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f696772-9f26-4772-bd65-a63f33294da6]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:08 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Volume volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb (5b3ac988-8773-48c6-b57a-9b13dc1eb2fb): created successfully Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3a48c6-389d-4c88-a8e5-fa878e119f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Flow 'volume_create_manager' (b1388301-05e4-4832-bc49-1caf54696801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:08 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-83be2456-241a-4f28-99a4-dac36da97ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Created volume successfully. Apr 24 17:11:08 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 Apr 24 17:11:08 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:08 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c" returned: 0 in 0.816s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:08 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c Apr 24 17:11:08 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:08 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297" returned: 0 in 0.626s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:08 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 1G Apr 24 17:11:08 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:08 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.4a4b1e28-2114-4364-9292-79f5a32d197c" returned: 0 in 0.489s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-4a4b1e28-2114-4364-9292-79f5a32d197c" released by "_delete_snapshot" :: held 3.027s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" released by "delete_snapshot" :: held 3.053s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:08 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Created reservations ['eb462eee-8093-4fdc-a332-b694f2304e34', 'c4c16e78-daa1-4d31-b9d6-5f25a0197d47', 'f5006310-fb40-4bf4-9bd9-6b211455361a', 'd6d31638-85e4-476f-bc15-9a396ff9fe76'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:09 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Delete snapshot completed successfully. Apr 24 17:11:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b537eced-5358-4fad-ac66-1b95e2d2f395 tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-4a4b1e28-2114-4364-9292-79f5a32d197c-delete_snapshot" released by "delete_snapshot" :: held 3.239s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:09 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 1G" returned: 0 in 0.661s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:09 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 Apr 24 17:11:09 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:09 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12" returned: 0 in 0.489s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:09 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 is being set with open permissions: ugo+rw Apr 24 17:11:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:09 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 Apr 24 17:11:09 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:10 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12" returned: 0 in 0.527s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:10 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.info Apr 24 17:11:10 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:10 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.info" returned: 0 in 0.450s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:10 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.info is being set with open permissions: ugo+rw Apr 24 17:11:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:10 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.info Apr 24 17:11:10 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:11 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.info" returned: 0 in 0.438s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.308s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.059s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Creating offline snapshot b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 of volume 5b3ac988-8773-48c6-b57a-9b13dc1eb2fb {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:11:11 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0c17e450-96c8-4a4b-9db3-a0dae78feedc tempest-VolumesSnapshotTestJSON-1260785796 None] Create snapshot completed successfully Apr 24 17:11:11 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb7cdb7-c25d-4838-b39c-e8d609e24ebf]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:11 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb Apr 24 17:11:11 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:11 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb" returned: 0 in 0.550s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:11 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 1G Apr 24 17:11:11 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Flow 'volume_create_manager' (386ece8a-a5a6-4a42-b8f4-a2bbcfdf7c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2d5b6a-6839-4d01-ac1b-a50f6943f719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2d5b6a-6839-4d01-ac1b-a50f6943f719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371317690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c77a6c2-fb80-426e-b085-115adc37f180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbfaf53b6e24b37a24c5848b950f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1ebc14da-4991-45cb-9fca-a0e5add03a12,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:12Z,use_quota=True,user_id='e45528ed28644465b86edaa06bba17cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11f1df3-90f4-44c2-bf0f-2232b6deb6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11f1df3-90f4-44c2-bf0f-2232b6deb6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8492a1bb-53d8-4b5c-a333-4fabf9cf6477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8492a1bb-53d8-4b5c-a333-4fabf9cf6477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c77a6c2-fb80-426e-b085-115adc37f180', 'volume_name': 'volume-3c77a6c2-fb80-426e-b085-115adc37f180', 'volume_size': 1, 'snapshot_id': '1ebc14da-4991-45cb-9fca-a0e5add03a12'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4c9836-7ca2-496e-b6c6-2ccb8863d54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4c9836-7ca2-496e-b6c6-2ccb8863d54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e61354-b55f-43bd-9df2-a8d4ab7cddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:12 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume 3c77a6c2-fb80-426e-b085-115adc37f180: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c77a6c2-fb80-426e-b085-115adc37f180', 'volume_size': 1, 'snapshot_id': '1ebc14da-4991-45cb-9fca-a0e5add03a12'} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:12 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 1G" returned: 0 in 0.727s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:12 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 Apr 24 17:11:12 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:13 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3" returned: 0 in 0.503s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:13 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 is being set with open permissions: ugo+rw Apr 24 17:11:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:13 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 Apr 24 17:11:13 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:13 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3" returned: 0 in 0.473s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:13 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.info Apr 24 17:11:13 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:14 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.info" returned: 0 in 0.448s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:14 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.info is being set with open permissions: ugo+rw Apr 24 17:11:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:14 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.info Apr 24 17:11:14 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:14 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.info" returned: 0 in 0.580s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.417s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.367s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:14 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-21eb8ce4-9162-4967-a2f6-ab811b141eac tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Create snapshot completed successfully Apr 24 17:11:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] Creating offline snapshot 9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb of volume 51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:11:14 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b18bcc-b269-4836-83c5-dbe30dccfb42]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:14 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:11:14 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:15 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.659s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:15 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb 1G Apr 24 17:11:15 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Acquiring lock "cinder-b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "cinder-b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Acquiring lock "cinder-quobyte-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "cinder-quobyte-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb" acquired by "delete_snapshot" :: waited 0.051s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Acquiring lock "cinder-quobyte-b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "cinder-quobyte-b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Deleting offline snapshot b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 of volume 5b3ac988-8773-48c6-b57a-9b13dc1eb2fb {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] snapshot_file for this snap is: volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3117a18-28ed-40a6-a8a3-9af12d85aa21]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:16 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 Apr 24 17:11:16 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:16 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb 1G" returned: 0 in 0.795s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:16 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb Apr 24 17:11:16 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:16 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3" returned: 0 in 0.664s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e99b48-f654-4917-bfa0-9e27477aaf09]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:16 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb" returned: 0 in 0.576s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:16 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb is being set with open permissions: ugo+rw Apr 24 17:11:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:16 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb Apr 24 17:11:16 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:16 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb Apr 24 17:11:16 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:17 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb" returned: 0 in 0.567s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:17 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.991s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-1ebc14da-4991-45cb-9fca-a0e5add03a12-3c77a6c2-fb80-426e-b085-115adc37f180" by "_create_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb" returned: 0 in 0.767s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:17 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 Apr 24 17:11:17 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-1ebc14da-4991-45cb-9fca-a0e5add03a12-3c77a6c2-fb80-426e-b085-115adc37f180" acquired by "_create_volume_from_snapshot" :: waited 0.107s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Creating volume 3c77a6c2-fb80-426e-b085-115adc37f180 from snapshot 1ebc14da-4991-45cb-9fca-a0e5add03a12 {{(pid=81986) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-3c77a6c2-fb80-426e-b085-115adc37f180" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:17 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-80402672-2ad8-45f0-ad63-502502e16155 tempest-SnapshotsActionsTest-2113282420 None] Create snapshot completed successfully Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-3c77a6c2-fb80-426e-b085-115adc37f180" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] snapshot: 1ebc14da-4991-45cb-9fca-a0e5add03a12, volume: 3c77a6c2-fb80-426e-b085-115adc37f180, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[96adcffa-e331-4373-a2af-4f7f45943492]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:17 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 Apr 24 17:11:17 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:18 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3" returned: 0 in 0.691s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:18 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3 Apr 24 17:11:18 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:18 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12" returned: 0 in 0.589s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689c7a9e-2c88-47ad-a222-7f9f0c977297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c5ae38-a415-4cbc-8df1-d5f0885a5335]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:18 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 Apr 24 17:11:18 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:18 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb.b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3" returned: 0 in 0.502s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "cinder-quobyte-b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3" released by "_delete_snapshot" :: held 2.762s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "cinder-quobyte-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb" released by "delete_snapshot" :: held 2.797s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:UPDATE=181,cinder:SELECT=173,cinder:INSERT=55,cinder:DELETE=16 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:11:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" acquired by "delete_snapshot" :: waited 0.046s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Acquiring lock "cinder-quobyte-9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Created reservations ['03c39b58-e078-44f5-8516-4d3fe714227d', 'e5900827-7087-4558-9af8-ff88a36b153e', 'dd621f2d-65f6-4a32-9ad3-aee6db71e4e3', '996934ec-f818-45ea-82cb-ff223364ebd3'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Deleting offline snapshot 9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb of volume 51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] snapshot_file for this snap is: volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21c7288-705f-4d94-bf55-84ab2ad1786b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:19 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:19 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Delete snapshot completed successfully. Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297" returned: 0 in 0.925s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180 not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f52b228d-ff3a-4415-864c-e72bcc76840e tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "cinder-b3f864ca-bf93-4ff7-aee1-9d8db9c0e6c3-delete_snapshot" released by "delete_snapshot" :: held 3.316s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:19 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180 Apr 24 17:11:19 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:19 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb Apr 24 17:11:19 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:19 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb" returned: 0 in 0.682s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebdd2c1-a43c-49ee-9ef3-21b9d414762d]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:20 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:11:20 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Acquiring lock "cinder-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "cinder-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Acquiring lock "cinder-quobyte-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "cinder-quobyte-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb" acquired by "delete_volume" :: waited 0.049s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:20 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2127217-277b-4e0b-a3af-1604017609f2]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:21 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb Apr 24 17:11:21 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:21 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 1.982s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:22 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb Apr 24 17:11:22 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:22 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb" returned: 0 in 1.611s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:22 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb Apr 24 17:11:22 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:23 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb" returned: 0 in 2.012s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:23 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb" returned: 0 in 1.400s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:24 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb Apr 24 17:11:24 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "cinder-quobyte-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb" released by "delete_volume" :: held 3.185s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:24 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Created reservations ['b4cafe26-0e8a-407c-a5b4-be38bd874098', 'caf24274-3210-47c4-abaa-a8f08ab4eda9', '7012cb20-799a-4608-b108-c6c3aae346e8', '249784e7-3850-412c-a7d6-b5dd4ede2d4a'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:24 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:11:24 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:25 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb" returned: 0 in 1.357s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb" released by "_delete_snapshot" :: held 6.261s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" released by "delete_snapshot" :: held 6.352s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:25 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 1.192s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:25 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:11:25 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Deleted volume successfully. Apr 24 17:11:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e34af702-d7ea-4a8f-af16-9fba40f5f966 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934813338 None] Lock "cinder-5b3ac988-8773-48c6-b57a-9b13dc1eb2fb-delete_volume" released by "delete_volume" :: held 4.952s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:25 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Created reservations ['ef90c2e2-8750-4951-9ff0-1de5f73c073f', '70283e33-9ae1-43e9-8c5e-86ad9c625b30', '36c8dcd0-80e4-4d83-a496-f75d17440815', 'a22845de-292e-42c2-8437-d8250a785dae'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:25 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180" returned: 0 in 6.523s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:25 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Delete snapshot completed successfully. Apr 24 17:11:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0d211204-9160-4bf3-846c-d88121593d8f tempest-SnapshotsActionsTest-174631379 None] Lock "cinder-9fdabdb2-a837-4c4b-9ebd-6c8ad978cbdb-delete_snapshot" released by "delete_snapshot" :: held 6.889s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:25 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6966d7-3366-47d4-b1f5-9b94b4ace86f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:26 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 Apr 24 17:11:26 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:26 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297" returned: 0 in 0.910s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:26 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:11:26 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Converted 1024.00 MB image at 156.96 MB/s Apr 24 17:11:26 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180 is being set with open permissions: ugo+rw Apr 24 17:11:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:26 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180 Apr 24 17:11:26 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "cinder-12af1fe2-b417-4c38-8ad6-5a36624f2e66-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Lock "cinder-12af1fe2-b417-4c38-8ad6-5a36624f2e66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "cinder-quobyte-12af1fe2-b417-4c38-8ad6-5a36624f2e66" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Lock "cinder-quobyte-12af1fe2-b417-4c38-8ad6-5a36624f2e66" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Deleting offline snapshot 12af1fe2-b417-4c38-8ad6-5a36624f2e66 of volume 51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] snapshot_file for this snap is: volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa03d95-17d8-4924-a43a-44d55a063cd3]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:27 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:11:27 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:27 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180" returned: 0 in 0.663s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-3c77a6c2-fb80-426e-b085-115adc37f180" released by "_copy_volume_from_snapshot" :: held 9.778s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-1ebc14da-4991-45cb-9fca-a0e5add03a12-3c77a6c2-fb80-426e-b085-115adc37f180" released by "_create_volume_from_snapshot" :: held 9.832s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.943s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=139,cinder:INSERT=41,cinder:UPDATE=150,cinder:DELETE=13 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e61354-b55f-43bd-9df2-a8d4ab7cddfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c77a6c2-fb80-426e-b085-115adc37f180', 'volume_size': 1, 'snapshot_id': '1ebc14da-4991-45cb-9fca-a0e5add03a12'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5afb7e1-c185-46cd-baeb-66ab81f3fe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:27 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Volume volume-3c77a6c2-fb80-426e-b085-115adc37f180 (3c77a6c2-fb80-426e-b085-115adc37f180): created successfully Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5afb7e1-c185-46cd-baeb-66ab81f3fe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Flow 'volume_create_manager' (386ece8a-a5a6-4a42-b8f4-a2bbcfdf7c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:27 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-6ff79e85-4436-44e0-97c1-08d05e9432c4 tempest-VolumesSnapshotTestJSON-1260785796 None] Created volume successfully. Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-3c77a6c2-fb80-426e-b085-115adc37f180-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:27 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.879s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a5393b-b692-4908-86d7-ed6186190c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-3c77a6c2-fb80-426e-b085-115adc37f180-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[77883db0-1f38-4994-b9f2-6e9728cee0a6]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-3c77a6c2-fb80-426e-b085-115adc37f180" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-3c77a6c2-fb80-426e-b085-115adc37f180" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfffdf71-52c4-443d-9211-6cfd755ecfcd]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:28 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 Apr 24 17:11:28 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:28 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180 Apr 24 17:11:28 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:28 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47" returned: 0 in 0.742s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:28 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:11:28 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:28 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180" returned: 0 in 0.796s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:28 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180 Apr 24 17:11:28 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:29 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.629s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:29 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66 Apr 24 17:11:29 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:29 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3c77a6c2-fb80-426e-b085-115adc37f180" returned: 0 in 0.538s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-3c77a6c2-fb80-426e-b085-115adc37f180" released by "delete_volume" :: held 1.381s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Created reservations ['fb5c1550-8290-4920-b16f-66618c7f4a0e', 'c41a421a-f9d6-43ea-936d-30e09debcd09', 'bc5cb932-009d-4ba1-9b21-1c4ced63731c', '3d8c1d58-77bf-4192-b2a8-ead49bfb529a'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:29 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:11:29 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:29 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47.12af1fe2-b417-4c38-8ad6-5a36624f2e66" returned: 0 in 0.560s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Lock "cinder-quobyte-12af1fe2-b417-4c38-8ad6-5a36624f2e66" released by "_delete_snapshot" :: held 2.948s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" released by "delete_snapshot" :: held 2.982s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Created reservations ['cc30e6c0-e9a0-4b46-a506-0d0298f4a70e', '3d52fe93-513a-4d9d-a84e-efdc449b72df', '5fb57dc3-4812-466f-a316-6fffc731064f', '3610b7dd-375b-4011-aa7f-397c1571a2ad'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:30 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Delete snapshot completed successfully. Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-216dcf65-93b2-4b54-849f-bbb0b7ee5afa tempest-SnapshotsActionsTest-2113282420 None] Lock "cinder-12af1fe2-b417-4c38-8ad6-5a36624f2e66-delete_snapshot" released by "delete_snapshot" :: held 3.151s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:30 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.620s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:11:30 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Deleted volume successfully. Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "cinder-51a5393b-b692-4908-86d7-ed6186190c47-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e0c3f138-d0be-4f9a-91f5-356ddaed429b tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-3c77a6c2-fb80-426e-b085-115adc37f180-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Lock "cinder-51a5393b-b692-4908-86d7-ed6186190c47-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" acquired by "delete_volume" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-1ebc14da-4991-45cb-9fca-a0e5add03a12-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f85b28-8fba-4892-8963-bf3bbe8f7d58]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Flow 'volume_create_manager' (08a7f36b-05be-4825-b2de-65e99df95154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67aca18-86cb-48a1-a079-47d63881b4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-1ebc14da-4991-45cb-9fca-a0e5add03a12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-689c7a9e-2c88-47ad-a222-7f9f0c977297" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:30 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 Apr 24 17:11:30 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67aca18-86cb-48a1-a079-47d63881b4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1975659534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688fd07f-0029-4581-8331-cb679752fea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ed6aa815fa4e3eaaac5ae80d8623fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:31Z,use_quota=True,user_id='fcddf5370290493f943f27b349beb31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d5fe53-b1ab-443b-9502-298ee9b079ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d5fe53-b1ab-443b-9502-298ee9b079ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28139e31-bdd6-4c12-b6dd-81af41816e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28139e31-bdd6-4c12-b6dd-81af41816e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '688fd07f-0029-4581-8331-cb679752fea6', 'volume_name': 'volume-688fd07f-0029-4581-8331-cb679752fea6', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58079614-f8ef-43e5-86bb-fe5e7a676915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58079614-f8ef-43e5-86bb-fe5e7a676915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7301acae-014d-4eba-a761-0b79d7c20644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:30 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Volume 688fd07f-0029-4581-8331-cb679752fea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-688fd07f-0029-4581-8331-cb679752fea6', 'volume_size': 1} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1975659534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688fd07f-0029-4581-8331-cb679752fea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ed6aa815fa4e3eaaac5ae80d8623fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:31Z,use_quota=True,user_id='fcddf5370290493f943f27b349beb31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Creating volume 688fd07f-0029-4581-8331-cb679752fea6 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:11:30 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-689c7a9e-2c88-47ad-a222-7f9f0c977297" acquired by "delete_snapshot" :: waited 0.077s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-1ebc14da-4991-45cb-9fca-a0e5add03a12" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:30 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6 1073741824 Apr 24 17:11:30 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-1ebc14da-4991-45cb-9fca-a0e5add03a12" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Deleting offline snapshot 1ebc14da-4991-45cb-9fca-a0e5add03a12 of volume 689c7a9e-2c88-47ad-a222-7f9f0c977297 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] snapshot_file for this snap is: volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[8668caaf-7f0b-40d1-9c62-29088b118b0c]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:30 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 Apr 24 17:11:30 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:31 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47" returned: 0 in 0.712s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:31 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47 Apr 24 17:11:31 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:31 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12" returned: 0 in 0.610s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-689c7a9e-2c88-47ad-a222-7f9f0c977297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:31 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6 1073741824" returned: 0 in 0.702s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:31 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ff71d4-f2fe-437a-8e44-b54c2f41fd20]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:31 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6 Apr 24 17:11:31 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:31 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 Apr 24 17:11:31 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:31 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-51a5393b-b692-4908-86d7-ed6186190c47" returned: 0 in 0.548s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Lock "cinder-quobyte-51a5393b-b692-4908-86d7-ed6186190c47" released by "delete_volume" :: held 1.358s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:31 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Created reservations ['19b302e1-8d14-4926-a41d-539ed33ef92b', '20754974-d033-4b38-bb2a-c4716f273acd', '225f411a-bdae-48d7-9843-325c96d725b2', '29d2f9d8-4b4c-4f76-94f7-9f53c73117c9'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:32 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:11:32 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:32 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:32 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297" returned: 0 in 0.695s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6" returned: 0 in 0.656s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:32 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 Apr 24 17:11:32 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7301acae-014d-4eba-a761-0b79d7c20644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-688fd07f-0029-4581-8331-cb679752fea6', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c460184e-2e3c-40c1-baee-8c46f6ab8b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:32 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Volume volume-688fd07f-0029-4581-8331-cb679752fea6 (688fd07f-0029-4581-8331-cb679752fea6): created successfully Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c460184e-2e3c-40c1-baee-8c46f6ab8b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Flow 'volume_create_manager' (08a7f36b-05be-4825-b2de-65e99df95154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:32 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-496f6c2c-d178-4047-95e2-e955c0d34e46 tempest-VolumesMetadataTest-1793624297 None] Created volume successfully. Apr 24 17:11:32 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.551s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:11:32 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Deleted volume successfully. Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7423a603-e1a0-466a-a20b-eeaf8ae18121 tempest-SnapshotsActionsTest-2113282420 None] Lock "cinder-51a5393b-b692-4908-86d7-ed6186190c47-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:32 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12" returned: 0 in 0.703s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:32 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12 Apr 24 17:11:32 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:33 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297.1ebc14da-4991-45cb-9fca-a0e5add03a12" returned: 0 in 0.618s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-1ebc14da-4991-45cb-9fca-a0e5add03a12" released by "_delete_snapshot" :: held 2.759s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-689c7a9e-2c88-47ad-a222-7f9f0c977297" released by "delete_snapshot" :: held 2.788s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Acquiring lock "cinder-688fd07f-0029-4581-8331-cb679752fea6-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Lock "cinder-688fd07f-0029-4581-8331-cb679752fea6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Acquiring lock "cinder-quobyte-688fd07f-0029-4581-8331-cb679752fea6" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Created reservations ['0e0192e8-468e-410d-b19d-f43666b92047', '509c0753-16bf-4979-8caa-7d9260d1beb4', 'b544bfef-80bd-46d7-b862-bdb0260e3d89', '0f28c5c4-afa5-413a-8bd6-3f83000c67ad'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Lock "cinder-quobyte-688fd07f-0029-4581-8331-cb679752fea6" acquired by "delete_volume" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Acquiring lock "cinder-22179e3a-b530-4075-9f09-933fad026943-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4410e74-a9c3-4845-895c-450c56336d90]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Lock "cinder-22179e3a-b530-4075-9f09-933fad026943-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:33 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Delete snapshot completed successfully. Apr 24 17:11:33 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6 Apr 24 17:11:33 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9a916b0b-8762-4c1f-8a44-fa7f9be86836 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-1ebc14da-4991-45cb-9fca-a0e5add03a12-delete_snapshot" released by "delete_snapshot" :: held 3.184s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Acquiring lock "cinder-quobyte-22179e3a-b530-4075-9f09-933fad026943" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Lock "cinder-quobyte-22179e3a-b530-4075-9f09-933fad026943" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ada7e5-da36-4807-ac7c-fdabe37e21d0]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:33 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943 Apr 24 17:11:33 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:34 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6" returned: 0 in 0.624s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:34 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6 Apr 24 17:11:34 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:34 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943" returned: 0 in 0.622s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:34 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943 Apr 24 17:11:34 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-689c7a9e-2c88-47ad-a222-7f9f0c977297-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:34 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-688fd07f-0029-4581-8331-cb679752fea6" returned: 0 in 0.591s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-689c7a9e-2c88-47ad-a222-7f9f0c977297-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Lock "cinder-quobyte-688fd07f-0029-4581-8331-cb679752fea6" released by "delete_volume" :: held 1.282s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-689c7a9e-2c88-47ad-a222-7f9f0c977297" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-689c7a9e-2c88-47ad-a222-7f9f0c977297" acquired by "delete_volume" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:35 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Created reservations ['81340bc9-351d-4020-bc43-1c3bb32df3e8', 'ab070383-a8fb-41f5-ac2e-9d992ef51152', 'f1794824-b1bf-42bf-9da7-4164a95db0d6', '5abe5686-3956-4b26-afeb-140b9008eb8d'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-22179e3a-b530-4075-9f09-933fad026943" returned: 0 in 0.553s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f3a00c-56c0-4c35-8f45-65d1f807c370]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Lock "cinder-quobyte-22179e3a-b530-4075-9f09-933fad026943" released by "delete_volume" :: held 1.243s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:35 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 Apr 24 17:11:35 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Created reservations ['f48c6e8e-c773-4237-a62f-f60ffe9e71bf', 'a16d0a70-860e-4c76-a6a4-cef38f8df1e8', 'f12cfa0b-4350-4b05-bf93-9867c2978ca9', 'ba3ad1ae-8890-4a97-84bc-d15ed80fad20'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:35 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:11:35 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:35 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:11:35 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:35 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297" returned: 0 in 0.663s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:35 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297 Apr 24 17:11:35 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:35 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.559s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:11:35 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Deleted volume successfully. Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-da7956aa-4526-43ec-b9b1-e4d97f392da5 tempest-VolumesMetadataTest-1793624297 None] Lock "cinder-688fd07f-0029-4581-8331-cb679752fea6-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:35 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.627s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:35 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:11:35 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Deleted volume successfully. Apr 24 17:11:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-b7e1ddde-fee1-4cc5-ab3b-02cf76d622ca tempest-VolumesNegativeTest-174520109 None] Lock "cinder-22179e3a-b530-4075-9f09-933fad026943-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:36 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-689c7a9e-2c88-47ad-a222-7f9f0c977297" returned: 0 in 0.547s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-689c7a9e-2c88-47ad-a222-7f9f0c977297" released by "delete_volume" :: held 1.305s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:36 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Created reservations ['3ecafbd6-588f-44e4-b6a5-10a6e2199e30', 'd34f09d8-7f31-46ec-ba81-fd5f71ef4ca7', '0121e525-dfae-4b1a-9b73-0de977c17fe5', '83294886-6d42-4956-8e7a-d5f60a2c844d'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:36 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:36 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:36 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:11:36 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:37 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.698s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:37 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:11:37 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Deleted volume successfully. Apr 24 17:11:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4e1b28c5-dede-483f-a238-6c205487ac35 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-689c7a9e-2c88-47ad-a222-7f9f0c977297-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-4e7b06cc-8aa0-4654-bbe5-5f069db72417-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-4e7b06cc-8aa0-4654-bbe5-5f069db72417-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "cinder-quobyte-4e7b06cc-8aa0-4654-bbe5-5f069db72417" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-4e7b06cc-8aa0-4654-bbe5-5f069db72417" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:37 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eae895-24f0-47f6-90c4-e3ca2a129d57]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:37 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 Apr 24 17:11:37 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:38 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417" returned: 0 in 0.653s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:38 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417 Apr 24 17:11:38 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:38 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4e7b06cc-8aa0-4654-bbe5-5f069db72417" returned: 0 in 0.590s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-quobyte-4e7b06cc-8aa0-4654-bbe5-5f069db72417" released by "delete_volume" :: held 1.321s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:38 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Created reservations ['5e741a48-cf8a-4c91-ba20-0fe55a95b26d', '538630a5-d137-48d2-a972-a0917f9016b6', '71e35124-07cd-45dd-b750-6c66b7999fa8', '0c4d5f60-3d38-4bd2-9f73-5129befaf757'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:38 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:11:38 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:39 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.506s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:11:39 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Deleted volume successfully. Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4cf1f0c8-7b8f-4d24-a986-d2ac38ea4fd9 tempest-VolumesSnapshotTestJSON-1260785796 None] Lock "cinder-4e7b06cc-8aa0-4654-bbe5-5f069db72417-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Flow 'volume_create_manager' (63a05c14-120f-4324-9acf-dce4dcef92a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9121180-8999-44c4-820b-34f9b46a1186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9121180-8999-44c4-820b-34f9b46a1186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1852530438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e01050c-bcae-46fc-90b5-551a4d6f965b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe95f94a2e646eaa0d31c6db0012322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:40Z,use_quota=True,user_id='fa39091b8774476eac87c2d48803348d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec949d5-3f59-4020-af51-f998a94d7f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec949d5-3f59-4020-af51-f998a94d7f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7898d88-6a21-4091-82ec-b50ae60f36b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7898d88-6a21-4091-82ec-b50ae60f36b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e01050c-bcae-46fc-90b5-551a4d6f965b', 'volume_name': 'volume-2e01050c-bcae-46fc-90b5-551a4d6f965b', 'volume_size': 2}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e89118-dbe0-4f3e-a937-422d98fee171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e89118-dbe0-4f3e-a937-422d98fee171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a842427-9887-4f7e-813c-184c218b6996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:39 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Volume 2e01050c-bcae-46fc-90b5-551a4d6f965b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e01050c-bcae-46fc-90b5-551a4d6f965b', 'volume_size': 2} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1852530438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e01050c-bcae-46fc-90b5-551a4d6f965b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe95f94a2e646eaa0d31c6db0012322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:40Z,use_quota=True,user_id='fa39091b8774476eac87c2d48803348d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Creating volume 2e01050c-bcae-46fc-90b5-551a4d6f965b {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:11:39 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:11:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b 2147483648 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:39 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b 2147483648 Apr 24 17:11:39 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:40 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b 2147483648" returned: 0 in 0.863s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:40 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b Apr 24 17:11:40 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:41 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b" returned: 0 in 0.607s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:41 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:11:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a842427-9887-4f7e-813c-184c218b6996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e01050c-bcae-46fc-90b5-551a4d6f965b', 'volume_size': 2}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fc0c1b-07ac-4636-a894-2bdd9b522098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:41 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Volume volume-2e01050c-bcae-46fc-90b5-551a4d6f965b (2e01050c-bcae-46fc-90b5-551a4d6f965b): created successfully Apr 24 17:11:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fc0c1b-07ac-4636-a894-2bdd9b522098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Flow 'volume_create_manager' (63a05c14-120f-4324-9acf-dce4dcef92a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:41 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-bcc73b6d-e1ce-42d9-8d75-720703b59436 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Created volume successfully. Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Creating offline snapshot 93779675-c527-4ec8-818b-0cc3e875ad70 of volume 2e01050c-bcae-46fc-90b5-551a4d6f965b {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa4ac46-b5e1-4000-a90b-496a5ab6a682]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Flow 'volume_create_manager' (28b32e8b-aa6e-4b20-8292-7e6d07b8c32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5d142a-646b-4556-ad99-93ec347ffbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5d142a-646b-4556-ad99-93ec347ffbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-251711525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f87b62f-68a0-4479-9672-2e5c58d73415,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9468fe9f1074edd8d8bc1917f7fef27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:42Z,use_quota=True,user_id='df92dbd54363426e885138b31373612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55ef196-cf14-4a5c-9d71-fc78c8dc9e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55ef196-cf14-4a5c-9d71-fc78c8dc9e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daabb0d0-e00a-449f-9010-219600b846f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daabb0d0-e00a-449f-9010-219600b846f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f87b62f-68a0-4479-9672-2e5c58d73415', 'volume_name': 'volume-9f87b62f-68a0-4479-9672-2e5c58d73415', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e92781-1c1c-420e-8147-7621681b2d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e92781-1c1c-420e-8147-7621681b2d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948ae0ca-b2e4-494d-86ef-309f716ac5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:42 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Volume 9f87b62f-68a0-4479-9672-2e5c58d73415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f87b62f-68a0-4479-9672-2e5c58d73415', 'volume_size': 1} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:42 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b Apr 24 17:11:42 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:42 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b" returned: 0 in 0.681s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 2G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:42 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 2G Apr 24 17:11:42 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:43 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 2G" returned: 0 in 0.748s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e01050c-bcae-46fc-90b5-551a4d6f965b -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:43 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e01050c-bcae-46fc-90b5-551a4d6f965b -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 Apr 24 17:11:43 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:44 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e01050c-bcae-46fc-90b5-551a4d6f965b -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70" returned: 0 in 0.706s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:44 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 is being set with open permissions: ugo+rw Apr 24 17:11:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:44 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 Apr 24 17:11:44 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:44 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70" returned: 0 in 0.597s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:44 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.info Apr 24 17:11:44 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:45 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.info" returned: 0 in 0.656s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:45 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.info is being set with open permissions: ugo+rw Apr 24 17:11:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:45 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.info Apr 24 17:11:45 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:46 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.info" returned: 0 in 0.506s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.017s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.861s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-251711525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f87b62f-68a0-4479-9672-2e5c58d73415,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9468fe9f1074edd8d8bc1917f7fef27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:42Z,use_quota=True,user_id='df92dbd54363426e885138b31373612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Creating volume 9f87b62f-68a0-4479-9672-2e5c58d73415 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:11:46 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:46 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415 1073741824 Apr 24 17:11:46 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:46 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-892a0dbb-6a3a-48c5-a7b9-a7c20da124dd tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Create snapshot completed successfully Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Acquiring lock "cinder-93779675-c527-4ec8-818b-0cc3e875ad70-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "cinder-93779675-c527-4ec8-818b-0cc3e875ad70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Acquiring lock "cinder-quobyte-2e01050c-bcae-46fc-90b5-551a4d6f965b" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "cinder-quobyte-2e01050c-bcae-46fc-90b5-551a4d6f965b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Acquiring lock "cinder-quobyte-93779675-c527-4ec8-818b-0cc3e875ad70" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "cinder-quobyte-93779675-c527-4ec8-818b-0cc3e875ad70" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Deleting offline snapshot 93779675-c527-4ec8-818b-0cc3e875ad70 of volume 2e01050c-bcae-46fc-90b5-551a4d6f965b {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] snapshot_file for this snap is: volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b030887-f82b-4440-aec4-e24877d32acb]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:46 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 Apr 24 17:11:46 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (4c24c6e4-8f16-4f12-a7e3-342ae31c6762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8acc27-c6e0-45bc-8137-3752ee81cd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8acc27-c6e0-45bc-8137-3752ee81cd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1807448063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad6390a-3dc1-474e-96be-09b386f0b0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:47Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41213516-324d-4356-b5be-da6d69d89b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41213516-324d-4356-b5be-da6d69d89b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202f421b-cee8-46a1-b26b-05d5685af6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202f421b-cee8-46a1-b26b-05d5685af6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad6390a-3dc1-474e-96be-09b386f0b0f7', 'volume_name': 'volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bd1454-1a80-4eaf-8256-c9fca58772b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bd1454-1a80-4eaf-8256-c9fca58772b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7ea445-4804-4f78-b14e-82bfc2ac7cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:46 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume 5ad6390a-3dc1-474e-96be-09b386f0b0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7', 'volume_size': 1} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:46 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415 1073741824" returned: 0 in 0.816s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:46 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415 Apr 24 17:11:46 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:47 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70" returned: 0 in 0.714s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e01050c-bcae-46fc-90b5-551a4d6f965b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6afa51-01e3-44f0-951e-c5ec216385cc]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:47 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b Apr 24 17:11:47 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:47 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415" returned: 0 in 0.494s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1807448063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad6390a-3dc1-474e-96be-09b386f0b0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:47Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Creating volume 5ad6390a-3dc1-474e-96be-09b386f0b0f7 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:11:47 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948ae0ca-b2e4-494d-86ef-309f716ac5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f87b62f-68a0-4479-9672-2e5c58d73415', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:47 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 1073741824 Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ce33e2-15e1-4173-967b-b972944a7881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:47 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:47 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Volume volume-9f87b62f-68a0-4479-9672-2e5c58d73415 (9f87b62f-68a0-4479-9672-2e5c58d73415): created successfully Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ce33e2-15e1-4173-967b-b972944a7881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Flow 'volume_create_manager' (28b32e8b-aa6e-4b20-8292-7e6d07b8c32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:47 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f1f6575e-dd93-41e9-8d20-74898ba70de7 tempest-VolumesListTestJSON-759437394 None] Created volume successfully. Apr 24 17:11:47 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b" returned: 0 in 0.597s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:47 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 Apr 24 17:11:47 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:48 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 1073741824" returned: 0 in 0.619s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:48 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 Apr 24 17:11:48 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:48 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70" returned: 0 in 0.541s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:48 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70 Apr 24 17:11:48 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:48 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7" returned: 0 in 0.512s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7ea445-4804-4f78-b14e-82bfc2ac7cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a08b810-926c-4f49-9cf3-2e2e02225756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:48 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 (5ad6390a-3dc1-474e-96be-09b386f0b0f7): created successfully Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a08b810-926c-4f49-9cf3-2e2e02225756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (4c24c6e4-8f16-4f12-a7e3-342ae31c6762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:48 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9da1f90e-512b-4103-8932-527d06689395 tempest-CreateVolumesFromSnapshotTest-210681883 None] Created volume successfully. Apr 24 17:11:48 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b.93779675-c527-4ec8-818b-0cc3e875ad70" returned: 0 in 0.496s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "cinder-quobyte-93779675-c527-4ec8-818b-0cc3e875ad70" released by "_delete_snapshot" :: held 2.502s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "cinder-quobyte-2e01050c-bcae-46fc-90b5-551a4d6f965b" released by "delete_snapshot" :: held 2.533s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Created reservations ['2daa8bf4-63da-4cb7-8566-40a0788bba71', '564ed5d1-5d86-4e81-aa59-1a6189301619', 'e4f24ff2-0f56-4da9-8be4-c8dd10a4c3d4', '21367c03-3267-4805-9e9b-f47a1e782521'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Flow 'volume_create_manager' (a2161fe4-fbe2-4309-9262-94236423b05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97437d1-117d-4191-a5ab-811c2befbe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97437d1-117d-4191-a5ab-811c2befbe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-229083769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d962ec-6708-4107-83bc-93d2336f959e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9468fe9f1074edd8d8bc1917f7fef27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:49Z,use_quota=True,user_id='df92dbd54363426e885138b31373612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac5bc9d-fe74-46fb-8405-7f44f5c58cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac5bc9d-fe74-46fb-8405-7f44f5c58cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd991af5-dc2e-4cc4-8fab-a4c724251701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd991af5-dc2e-4cc4-8fab-a4c724251701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4d962ec-6708-4107-83bc-93d2336f959e', 'volume_name': 'volume-d4d962ec-6708-4107-83bc-93d2336f959e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c054d1-23c8-4639-a5b0-a024f6ae9398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c054d1-23c8-4639-a5b0-a024f6ae9398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49729593-0aee-43eb-bb6c-624a393dda65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:49 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Volume d4d962ec-6708-4107-83bc-93d2336f959e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4d962ec-6708-4107-83bc-93d2336f959e', 'volume_size': 1} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-229083769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d962ec-6708-4107-83bc-93d2336f959e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9468fe9f1074edd8d8bc1917f7fef27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:49Z,use_quota=True,user_id='df92dbd54363426e885138b31373612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Creating volume d4d962ec-6708-4107-83bc-93d2336f959e {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:11:49 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:49 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e 1073741824 Apr 24 17:11:49 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:49 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Delete snapshot completed successfully. Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e7c8821-31c8-43ad-a29f-075c788e93e8 tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "cinder-93779675-c527-4ec8-818b-0cc3e875ad70-delete_snapshot" released by "delete_snapshot" :: held 2.816s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Acquiring lock "cinder-2e01050c-bcae-46fc-90b5-551a4d6f965b-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "cinder-2e01050c-bcae-46fc-90b5-551a4d6f965b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Acquiring lock "cinder-quobyte-2e01050c-bcae-46fc-90b5-551a4d6f965b" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "cinder-quobyte-2e01050c-bcae-46fc-90b5-551a4d6f965b" acquired by "delete_volume" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a89dbf-8402-48cc-a2bb-ca6be313e617]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:49 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b Apr 24 17:11:49 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:49 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e 1073741824" returned: 0 in 0.789s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:50 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e Apr 24 17:11:50 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:50 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b" returned: 0 in 0.646s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:50 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b Apr 24 17:11:50 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:50 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e" returned: 0 in 0.523s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.342s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49729593-0aee-43eb-bb6c-624a393dda65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d962ec-6708-4107-83bc-93d2336f959e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92524e54-f1ad-4be4-972e-2ae0870020b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] Creating offline snapshot 6d96c149-a0e5-4de2-9bff-58ca3c86f6ca of volume 5ad6390a-3dc1-474e-96be-09b386f0b0f7 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:11:50 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Volume volume-d4d962ec-6708-4107-83bc-93d2336f959e (d4d962ec-6708-4107-83bc-93d2336f959e): created successfully Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92524e54-f1ad-4be4-972e-2ae0870020b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Flow 'volume_create_manager' (a2161fe4-fbe2-4309-9262-94236423b05e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb5dc3a-843a-4417-8bfe-482e7274911e]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:50 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-32f5eacf-b51c-45e6-9f97-fbcd68cd34e4 tempest-VolumesListTestJSON-759437394 None] Created volume successfully. Apr 24 17:11:50 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 Apr 24 17:11:50 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:50 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2e01050c-bcae-46fc-90b5-551a4d6f965b" returned: 0 in 0.489s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "cinder-quobyte-2e01050c-bcae-46fc-90b5-551a4d6f965b" released by "delete_volume" :: held 1.205s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Created reservations ['e0dba7c7-ff46-4750-b22c-b01e304b90cd', '95a559c1-cb9c-4ec5-9fa5-0e20ee996889', 'de9b0930-bcf0-4c1e-8bd8-80f3f61c5a4c', '308fb4ed-5333-49cc-a087-66c5dc543dc1'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:51 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:11:51 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:51 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7" returned: 0 in 0.706s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:51 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca 1G Apr 24 17:11:51 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Flow 'volume_create_manager' (384cad62-f218-42b0-ae2f-5464ce5a68a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b2393f-cc26-4e8f-8574-c531d45bcbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b2393f-cc26-4e8f-8574-c531d45bcbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1846015998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a717a3d-7515-4fdc-9d17-7fdf3c226dd1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9468fe9f1074edd8d8bc1917f7fef27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:52Z,use_quota=True,user_id='df92dbd54363426e885138b31373612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41938947-50f8-454d-af82-82ca222b521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41938947-50f8-454d-af82-82ca222b521d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d804b1c7-09db-4241-a239-0eb474ccf984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d804b1c7-09db-4241-a239-0eb474ccf984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a717a3d-7515-4fdc-9d17-7fdf3c226dd1', 'volume_name': 'volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ba2815-a3aa-4f3f-aa38-0a28a177216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ba2815-a3aa-4f3f-aa38-0a28a177216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926186bd-ef80-4356-bf6f-c77fd7b11eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:51 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Volume 6a717a3d-7515-4fdc-9d17-7fdf3c226dd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1', 'volume_size': 1} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:51 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.660s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:11:51 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Deleted volume successfully. Apr 24 17:11:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9341eb64-9fd6-4c74-a355-ff06da06eccf tempest-VolumesSnapshotNegativeTestJSON-460690472 None] Lock "cinder-2e01050c-bcae-46fc-90b5-551a4d6f965b-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:11:52 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca 1G" returned: 0 in 0.795s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:52 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca Apr 24 17:11:52 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:52 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca" returned: 0 in 0.669s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:52 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca is being set with open permissions: ugo+rw Apr 24 17:11:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:52 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca Apr 24 17:11:52 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:53 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca" returned: 0 in 0.608s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:53 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.info Apr 24 17:11:53 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:54 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.info" returned: 0 in 0.605s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:54 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.info is being set with open permissions: ugo+rw Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:54 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.info Apr 24 17:11:54 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:54 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.info" returned: 0 in 0.595s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.142s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.909s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1846015998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a717a3d-7515-4fdc-9d17-7fdf3c226dd1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9468fe9f1074edd8d8bc1917f7fef27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:52Z,use_quota=True,user_id='df92dbd54363426e885138b31373612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Creating volume 6a717a3d-7515-4fdc-9d17-7fdf3c226dd1 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:11:54 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:11:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:54 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1 1073741824 Apr 24 17:11:54 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:54 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-c8e45aed-ffb7-492b-8686-b1fc6e8c3481 tempest-CreateVolumesFromSnapshotTest-210681883 None] Create snapshot completed successfully Apr 24 17:11:55 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1 1073741824" returned: 0 in 0.839s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:55 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1 Apr 24 17:11:55 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (0ff360c2-fcca-4b5b-9795-6343b9d4533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd882db-2293-4a2f-9deb-e8c2f39765ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd882db-2293-4a2f-9deb-e8c2f39765ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281786546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c7f723-6616-468d-bd7f-14f7e6ec8603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:56Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c36cab-4a29-4edc-ba26-2acd07d0c851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c36cab-4a29-4edc-ba26-2acd07d0c851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4da609c-35e9-4fc9-9522-ea5efa264620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4da609c-35e9-4fc9-9522-ea5efa264620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c7f723-6616-468d-bd7f-14f7e6ec8603', 'volume_name': 'volume-68c7f723-6616-468d-bd7f-14f7e6ec8603', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4ce245-b586-487b-979d-07a56022013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4ce245-b586-487b-979d-07a56022013d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c45219-749b-40d4-9379-23dbb762dd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:55 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume 68c7f723-6616-468d-bd7f-14f7e6ec8603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c7f723-6616-468d-bd7f-14f7e6ec8603', 'volume_size': 1} Apr 24 17:11:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (d2462738-9f65-4e7a-a42c-9581680d330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c1e4a2-c49c-4417-b255-a276384aa43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c1e4a2-c49c-4417-b255-a276384aa43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-89355352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625d0a81-bc6a-4480-a3ed-3e2f90bf35a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:56Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47fc8c0-ccda-4a78-991f-2ba21b7e357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47fc8c0-ccda-4a78-991f-2ba21b7e357e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d500743c-5e81-469b-9855-53c29df78cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d500743c-5e81-469b-9855-53c29df78cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625d0a81-bc6a-4480-a3ed-3e2f90bf35a3', 'volume_name': 'volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:56 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df1e26c-7ccc-482a-94f5-80afefc883dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df1e26c-7ccc-482a-94f5-80afefc883dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c595c1-5a01-4f0a-84be-f02bc58e983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:56 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume 625d0a81-bc6a-4480-a3ed-3e2f90bf35a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3', 'volume_size': 1} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1" returned: 0 in 0.926s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.515s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281786546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c7f723-6616-468d-bd7f-14f7e6ec8603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:56Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Creating volume 68c7f723-6616-468d-bd7f-14f7e6ec8603 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:11:56 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926186bd-ef80-4356-bf6f-c77fd7b11eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da99d75-afb0-4cd4-8a3b-24af9f586b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:56 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Volume volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1 (6a717a3d-7515-4fdc-9d17-7fdf3c226dd1): created successfully Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da99d75-afb0-4cd4-8a3b-24af9f586b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Flow 'volume_create_manager' (384cad62-f218-42b0-ae2f-5464ce5a68a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:56 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e6004965-e5de-4b60-a63f-f8c9cf8b0ee3 tempest-VolumesListTestJSON-759437394 None] Created volume successfully. Apr 24 17:11:56 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603 1073741824 Apr 24 17:11:56 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (3a69d09d-10fb-4ad3-9aeb-c5070eab7f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60021c8a-2af5-468a-a721-42e1ea5349d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60021c8a-2af5-468a-a721-42e1ea5349d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216749032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff954c1-632b-4f18-b090-3bcb58699043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:57Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5df1c7-010e-4aa2-a050-1258c6f66bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5df1c7-010e-4aa2-a050-1258c6f66bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a935a6-6686-46c2-a6ff-f6cbfc398cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a935a6-6686-46c2-a6ff-f6cbfc398cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff954c1-632b-4f18-b090-3bcb58699043', 'volume_name': 'volume-5ff954c1-632b-4f18-b090-3bcb58699043', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db568c21-4b64-463f-b424-6c5932eb3da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db568c21-4b64-463f-b424-6c5932eb3da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11ec2de-2675-49f4-91dc-d3902ce68121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:56 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume 5ff954c1-632b-4f18-b090-3bcb58699043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff954c1-632b-4f18-b090-3bcb58699043', 'volume_size': 1} Apr 24 17:11:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (0e5a702c-2825-474e-8217-2b9cb72f3817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c174bd46-a135-4dab-8ac8-94b6ee4da772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c174bd46-a135-4dab-8ac8-94b6ee4da772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244695456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e938dc4e-3717-4f82-b4a0-55593660b161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:57Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d768cc8-aedb-48bc-9183-b33eb626c42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d768cc8-aedb-48bc-9183-b33eb626c42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfffc90-0610-432e-b13f-0f3b44cbd854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfffc90-0610-432e-b13f-0f3b44cbd854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e938dc4e-3717-4f82-b4a0-55593660b161', 'volume_name': 'volume-e938dc4e-3717-4f82-b4a0-55593660b161', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b295a485-4c73-46d9-a1eb-e6777070095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b295a485-4c73-46d9-a1eb-e6777070095f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611976b9-81fe-45d8-aaaa-4ea942d1dd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:57 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume e938dc4e-3717-4f82-b4a0-55593660b161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e938dc4e-3717-4f82-b4a0-55593660b161', 'volume_size': 1} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:57 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603 1073741824" returned: 0 in 1.135s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (50caa4c3-c1c6-4f2a-8b10-6d4b35126740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba2a147-fd34-444d-a5ff-5417e04a2978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba2a147-fd34-444d-a5ff-5417e04a2978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1082252229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a31589-5928-473f-8a96-0568f301c272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:58Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf880cd-8055-4466-b887-06da948c3311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf880cd-8055-4466-b887-06da948c3311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b9d47f-63c7-44b8-a10f-aa608a964144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b9d47f-63c7-44b8-a10f-aa608a964144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a31589-5928-473f-8a96-0568f301c272', 'volume_name': 'volume-e3a31589-5928-473f-8a96-0568f301c272', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c33b280-3cae-4851-b4d2-1da17f18f5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c33b280-3cae-4851-b4d2-1da17f18f5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e650f14-fecc-4789-a391-ab3564cd3cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:57 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume e3a31589-5928-473f-8a96-0568f301c272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a31589-5928-473f-8a96-0568f301c272', 'volume_size': 1} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:57 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603 Apr 24 17:11:57 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:58 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603" returned: 0 in 0.672s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.989s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-89355352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625d0a81-bc6a-4480-a3ed-3e2f90bf35a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:56Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Creating volume 625d0a81-bc6a-4480-a3ed-3e2f90bf35a3 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:11:58 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c45219-749b-40d4-9379-23dbb762dd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c7f723-6616-468d-bd7f-14f7e6ec8603', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe428187-7d3c-4c71-97c7-c9ae8182c51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:11:58 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3 1073741824 Apr 24 17:11:58 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:58 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume volume-68c7f723-6616-468d-bd7f-14f7e6ec8603 (68c7f723-6616-468d-bd7f-14f7e6ec8603): created successfully Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe428187-7d3c-4c71-97c7-c9ae8182c51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:11:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (0ff360c2-fcca-4b5b-9795-6343b9d4533c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:11:58 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-624a6f6d-bbc4-4589-b079-532e56321d76 tempest-CreateVolumesFromSnapshotTest-210681883 None] Created volume successfully. Apr 24 17:11:59 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 24 17:11:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3 1073741824" returned: 0 in 1.106s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:11:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:11:59 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3 Apr 24 17:11:59 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:11:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "cinder-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Lock "cinder-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "cinder-quobyte-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:11:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Lock "cinder-quobyte-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1" acquired by "delete_volume" :: waited 0.034s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:11:59 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[806ad71e-014e-4cbb-9589-5e64f3f31b12]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:11:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:00 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1 Apr 24 17:12:00 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:00 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3" returned: 0 in 0.640s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.477s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216749032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff954c1-632b-4f18-b090-3bcb58699043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:57Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Creating volume 5ff954c1-632b-4f18-b090-3bcb58699043 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:00 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c595c1-5a01-4f0a-84be-f02bc58e983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f485b4ef-d913-4aaa-868b-db54560e7eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:00 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3 (625d0a81-bc6a-4480-a3ed-3e2f90bf35a3): created successfully Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f485b4ef-d913-4aaa-868b-db54560e7eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (d2462738-9f65-4e7a-a42c-9581680d330b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:00 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043 1073741824 Apr 24 17:12:00 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:00 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-25e68002-839b-4a17-87d9-b77b2fb0df85 tempest-CreateVolumesFromSnapshotTest-210681883 None] Created volume successfully. Apr 24 17:12:00 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1" returned: 0 in 0.673s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:00 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1 Apr 24 17:12:00 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:01 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043 1073741824" returned: 0 in 1.026s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:01 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043 Apr 24 17:12:01 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:01 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1" returned: 0 in 0.870s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Lock "cinder-quobyte-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1" released by "delete_volume" :: held 1.590s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Created reservations ['78fe3676-514b-4897-9b5a-4a45e8551c3c', '8e1d12ab-1b70-4119-b559-b02b76b27819', '8332f8b1-fb40-4233-88f7-747e9ed3ce38', 'bfec982a-2e63-4a47-84e7-ad031542a77b'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:01 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:01 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:01 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043" returned: 0 in 0.598s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.542s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244695456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e938dc4e-3717-4f82-b4a0-55593660b161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:57Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Creating volume e938dc4e-3717-4f82-b4a0-55593660b161 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:02 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11ec2de-2675-49f4-91dc-d3902ce68121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff954c1-632b-4f18-b090-3bcb58699043', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a53eb3-c2b7-461f-bda7-5ab928240605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:02 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume volume-5ff954c1-632b-4f18-b090-3bcb58699043 (5ff954c1-632b-4f18-b090-3bcb58699043): created successfully Apr 24 17:12:02 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161 1073741824 Apr 24 17:12:02 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a53eb3-c2b7-461f-bda7-5ab928240605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (3a69d09d-10fb-4ad3-9aeb-c5070eab7f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:02 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-881fefe4-1d56-408b-a80b-693d03fececc tempest-CreateVolumesFromSnapshotTest-210681883 None] Created volume successfully. Apr 24 17:12:02 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.852s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:02 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Deleted volume successfully. Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-77b731db-f138-4a6d-a699-67ca9d196787 tempest-VolumesListTestJSON-759437394 None] Lock "cinder-6a717a3d-7515-4fdc-9d17-7fdf3c226dd1-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Acquiring lock "cinder-d4d962ec-6708-4107-83bc-93d2336f959e-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Flow 'volume_create_manager' (d069d463-2d2b-4713-b0b8-642b550cf834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6d8bfb-4e38-46c2-8e1a-5ed45575a4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6d8bfb-4e38-46c2-8e1a-5ed45575a4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1204796097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247e6a21-32a5-4688-bd10-fe82ebad5c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17fe7bcfc0a445a199c5312641f4b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:03Z,use_quota=True,user_id='67a0a26ba5f04ee29ab859b5258ea49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9e7669-0ea0-46b9-a798-0fcd0611966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9e7669-0ea0-46b9-a798-0fcd0611966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d7150e-0381-476b-9e8e-0fb828eca668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d7150e-0381-476b-9e8e-0fb828eca668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '247e6a21-32a5-4688-bd10-fe82ebad5c03', 'volume_name': 'volume-247e6a21-32a5-4688-bd10-fe82ebad5c03', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f475348b-223e-452f-a3ee-152b93c9fd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f475348b-223e-452f-a3ee-152b93c9fd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f8c76c-e85d-4d40-99fa-8f19f20897ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:02 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Volume 247e6a21-32a5-4688-bd10-fe82ebad5c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-247e6a21-32a5-4688-bd10-fe82ebad5c03', 'volume_size': 1} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Lock "cinder-d4d962ec-6708-4107-83bc-93d2336f959e-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:02 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:02 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:02 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161 1073741824" returned: 0 in 0.949s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Acquiring lock "cinder-quobyte-d4d962ec-6708-4107-83bc-93d2336f959e" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Lock "cinder-quobyte-d4d962ec-6708-4107-83bc-93d2336f959e" acquired by "delete_volume" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:03 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161 Apr 24 17:12:03 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c92d2ef-1ae8-4e9e-9337-b844f96ebc32]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:03 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e Apr 24 17:12:03 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:03 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.498s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:03 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161" returned: 0 in 0.562s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.764s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1082252229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a31589-5928-473f-8a96-0568f301c272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e4b776dae14260bbd777a970e47cef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:11:58Z,use_quota=True,user_id='1fbb39a8a7d9490ebaae8717d3c90f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Creating volume e3a31589-5928-473f-8a96-0568f301c272 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:03 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611976b9-81fe-45d8-aaaa-4ea942d1dd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e938dc4e-3717-4f82-b4a0-55593660b161', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6e216d-471c-4a2f-a4fc-ecf56d36b503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:03 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272 1073741824 Apr 24 17:12:03 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:03 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume volume-e938dc4e-3717-4f82-b4a0-55593660b161 (e938dc4e-3717-4f82-b4a0-55593660b161): created successfully Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6e216d-471c-4a2f-a4fc-ecf56d36b503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (0e5a702c-2825-474e-8217-2b9cb72f3817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:03 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-c10ffbc4-d0cc-4688-8272-2a6c76e4a430 tempest-CreateVolumesFromSnapshotTest-210681883 None] Created volume successfully. Apr 24 17:12:03 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e" returned: 0 in 0.697s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:03 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e Apr 24 17:12:03 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:04 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d4d962ec-6708-4107-83bc-93d2336f959e" returned: 0 in 0.462s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:04 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Lock "cinder-quobyte-d4d962ec-6708-4107-83bc-93d2336f959e" released by "delete_volume" :: held 1.214s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272 1073741824" returned: 0 in 0.684s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Created reservations ['30bedbd7-1723-4e4c-956f-a4f7adab602a', 'e5e67f48-a9e3-47bc-91a0-e7e3f7177ded', 'aa232e14-39e5-41f7-a13a-365cdde6edfd', '1818ed6b-7aa9-4bb8-a568-f6543492b945'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:04 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272 Apr 24 17:12:04 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:04 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:04 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:04 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272" returned: 0 in 0.538s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.973s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1204796097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247e6a21-32a5-4688-bd10-fe82ebad5c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17fe7bcfc0a445a199c5312641f4b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:03Z,use_quota=True,user_id='67a0a26ba5f04ee29ab859b5258ea49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Creating volume 247e6a21-32a5-4688-bd10-fe82ebad5c03 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:04 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e650f14-fecc-4789-a391-ab3564cd3cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a31589-5928-473f-8a96-0568f301c272', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fc183b-b9e5-4118-8ae6-0b4e5362a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:04 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03 1073741824 Apr 24 17:12:04 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:04 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Volume volume-e3a31589-5928-473f-8a96-0568f301c272 (e3a31589-5928-473f-8a96-0568f301c272): created successfully Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fc183b-b9e5-4118-8ae6-0b4e5362a493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:04 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Flow 'volume_create_manager' (50caa4c3-c1c6-4f2a-8b10-6d4b35126740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:04 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:05 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d5310032-593e-4fd2-a3f5-cd7595b33c0f tempest-CreateVolumesFromSnapshotTest-210681883 None] Created volume successfully. Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.574s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:05 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Deleted volume successfully. Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4c651fe8-54bd-4787-8e51-5222e6b2079a tempest-VolumesListTestJSON-759437394 None] Lock "cinder-d4d962ec-6708-4107-83bc-93d2336f959e-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "cinder-9f87b62f-68a0-4479-9672-2e5c58d73415-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Lock "cinder-9f87b62f-68a0-4479-9672-2e5c58d73415-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "cinder-quobyte-9f87b62f-68a0-4479-9672-2e5c58d73415" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Lock "cinder-quobyte-9f87b62f-68a0-4479-9672-2e5c58d73415" acquired by "delete_volume" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbf910b-9409-4476-a0f8-4a1cfa371ed9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:05 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415 Apr 24 17:12:05 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:05 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03 1073741824" returned: 0 in 0.782s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:05 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03 Apr 24 17:12:05 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:05 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415" returned: 0 in 0.638s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:05 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415 Apr 24 17:12:05 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-e3a31589-5928-473f-8a96-0568f301c272-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-e3a31589-5928-473f-8a96-0568f301c272-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-quobyte-e3a31589-5928-473f-8a96-0568f301c272" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-e3a31589-5928-473f-8a96-0568f301c272" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5781aa0a-edbc-4c3e-ae9d-1a849a2914c9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:06 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272 Apr 24 17:12:06 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:06 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03" returned: 0 in 0.610s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f8c76c-e85d-4d40-99fa-8f19f20897ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-247e6a21-32a5-4688-bd10-fe82ebad5c03', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1603b12e-55fa-4ecb-9f7c-48abba279822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:06 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Volume volume-247e6a21-32a5-4688-bd10-fe82ebad5c03 (247e6a21-32a5-4688-bd10-fe82ebad5c03): created successfully Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1603b12e-55fa-4ecb-9f7c-48abba279822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Flow 'volume_create_manager' (d069d463-2d2b-4713-b0b8-642b550cf834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:06 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-40dddbee-085e-4c10-b556-8e9c60c83bec tempest-VolumeQuotasAdminTestJSON-1802494709 None] Created volume successfully. Apr 24 17:12:06 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9f87b62f-68a0-4479-9672-2e5c58d73415" returned: 0 in 0.617s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Lock "cinder-quobyte-9f87b62f-68a0-4479-9672-2e5c58d73415" released by "delete_volume" :: held 1.301s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Created reservations ['a82df982-1046-41ae-9d21-26b108cf3f4a', 'a5bf8559-9ac7-4a07-833b-b07cc1d04c79', 'd44a1d59-752d-494d-ba1d-0f235fa9dfa0', 'c241aaba-9445-407d-9b5c-cdba5855ca67'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:06 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:06 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:06 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272" returned: 0 in 0.673s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:06 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272 Apr 24 17:12:06 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:07 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.490s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:07 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Deleted volume successfully. Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1e8ec6bf-3dd2-4926-a3f9-99bd42ba6764 tempest-VolumesListTestJSON-759437394 None] Lock "cinder-9f87b62f-68a0-4479-9672-2e5c58d73415-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Acquiring lock "cinder-247e6a21-32a5-4688-bd10-fe82ebad5c03-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "cinder-247e6a21-32a5-4688-bd10-fe82ebad5c03-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Acquiring lock "cinder-quobyte-247e6a21-32a5-4688-bd10-fe82ebad5c03" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "cinder-quobyte-247e6a21-32a5-4688-bd10-fe82ebad5c03" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85071a7-c0bf-4978-a604-ec75753f24ec]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:07 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03 Apr 24 17:12:07 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:07 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e3a31589-5928-473f-8a96-0568f301c272" returned: 0 in 0.761s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-e3a31589-5928-473f-8a96-0568f301c272" released by "delete_volume" :: held 1.484s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Created reservations ['46146c70-cc4e-4286-ad48-5d8e52c70ca6', '05006c42-2631-4db5-866c-fa0019db2f52', '369c2dcf-1daf-4a40-b6bf-cdc5531f603d', 'f7f83978-7386-487e-83d5-f30f09522ad2'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:07 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:07 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:08 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03" returned: 0 in 0.732s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:08 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03 Apr 24 17:12:08 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-e938dc4e-3717-4f82-b4a0-55593660b161-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-e938dc4e-3717-4f82-b4a0-55593660b161-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:08 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.659s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:08 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Deleted volume successfully. Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-quobyte-e938dc4e-3717-4f82-b4a0-55593660b161" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ab820c81-915c-4a0c-95be-97229e220b5f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-e3a31589-5928-473f-8a96-0568f301c272-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-e938dc4e-3717-4f82-b4a0-55593660b161" acquired by "delete_volume" :: waited 0.030s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0073ec-f04b-4e78-96f4-df6d9466c2a8]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:08 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161 Apr 24 17:12:08 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:08 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-247e6a21-32a5-4688-bd10-fe82ebad5c03" returned: 0 in 0.782s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "cinder-quobyte-247e6a21-32a5-4688-bd10-fe82ebad5c03" released by "delete_volume" :: held 1.563s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Created reservations ['8f25e325-f242-44e1-8cda-0e7f0214f0d2', 'b02db0f0-ed3d-44dc-a80a-a13d7beaeb73', '9da5c790-a8d5-4714-b4f2-4914b847da40', 'fdd27ab1-db7d-4578-9705-f143b960a188'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:09 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:09 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:09 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161" returned: 0 in 0.721s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:09 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161 Apr 24 17:12:09 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:09 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.722s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:09 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Deleted volume successfully. Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4f3ae40b-0176-4c98-b95f-f48a7a3c984f tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "cinder-247e6a21-32a5-4688-bd10-fe82ebad5c03-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:09 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e938dc4e-3717-4f82-b4a0-55593660b161" returned: 0 in 0.699s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-e938dc4e-3717-4f82-b4a0-55593660b161" released by "delete_volume" :: held 1.471s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Created reservations ['a654624d-8e4f-48bb-bc24-d56c8ccf687f', 'e2f32abe-d8fd-4577-affa-59c34f1e633e', '99722d10-7f1c-4074-99bd-0156bbaa90c0', 'bb0d4a60-d552-4899-a391-186ed1db14c7'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Flow 'volume_create_manager' (02c2ef32-569e-4190-a994-4db20c386ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec8e23e-2caa-4cfd-8ec8-9721dacb2206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec8e23e-2caa-4cfd-8ec8-9721dacb2206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1509257457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41831e24-32bb-4fe9-a657-9bc8cb67a83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17fe7bcfc0a445a199c5312641f4b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:10Z,use_quota=True,user_id='67a0a26ba5f04ee29ab859b5258ea49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed8679e-7845-4dbc-afa1-3565edbc3bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed8679e-7845-4dbc-afa1-3565edbc3bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea901ab1-4833-4f21-9ade-5e67d2c064a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea901ab1-4833-4f21-9ade-5e67d2c064a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41831e24-32bb-4fe9-a657-9bc8cb67a83a', 'volume_name': 'volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab51959-4c9a-4695-b51f-ff348ddd4044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab51959-4c9a-4695-b51f-ff348ddd4044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1b42ac-df24-43c0-9f25-604489de518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:10 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Volume 41831e24-32bb-4fe9-a657-9bc8cb67a83a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a', 'volume_size': 1} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1509257457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41831e24-32bb-4fe9-a657-9bc8cb67a83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17fe7bcfc0a445a199c5312641f4b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:10Z,use_quota=True,user_id='67a0a26ba5f04ee29ab859b5258ea49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Creating volume 41831e24-32bb-4fe9-a657-9bc8cb67a83a {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:10 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:10 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a 1073741824 Apr 24 17:12:10 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:10 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:10 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-5ff954c1-632b-4f18-b090-3bcb58699043-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-5ff954c1-632b-4f18-b090-3bcb58699043-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-quobyte-5ff954c1-632b-4f18-b090-3bcb58699043" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-5ff954c1-632b-4f18-b090-3bcb58699043" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73ee531-0365-40f8-ba86-d7f49865ff33]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:10 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.674s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:10 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:10 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043 Apr 24 17:12:10 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:10 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Deleted volume successfully. Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-7ee4c0d1-7dd6-4a16-9bda-f0a7e079066f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-e938dc4e-3717-4f82-b4a0-55593660b161-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Flow 'volume_create_manager' (919d2766-ddfc-407d-8df0-0eb12f388199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99dab43c-63fb-4ce8-a173-1c532bdb6fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99dab43c-63fb-4ce8-a173-1c532bdb6fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-899630555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02cd3b06-fc67-4bec-b987-380b1dc8ee71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d598ceec17546c39b0361ca3cfb47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:11Z,use_quota=True,user_id='8597307fea774bc5b7a80da8c158955b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a3651d-3c1e-43ce-9337-253f1bcf0779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:11 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a3651d-3c1e-43ce-9337-253f1bcf0779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056c0446-cc42-4bb1-86a0-8ecb62aba997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056c0446-cc42-4bb1-86a0-8ecb62aba997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02cd3b06-fc67-4bec-b987-380b1dc8ee71', 'volume_name': 'volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a313d7b0-8d6f-454f-b988-e6697302f1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a313d7b0-8d6f-454f-b988-e6697302f1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887fa00b-daf1-4227-94a9-c6810e2249c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:11 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Volume 02cd3b06-fc67-4bec-b987-380b1dc8ee71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71', 'volume_size': 1} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a 1073741824" returned: 0 in 0.862s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:11 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a Apr 24 17:12:11 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:11 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043" returned: 0 in 0.649s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:11 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043 Apr 24 17:12:11 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:11 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a" returned: 0 in 0.504s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-899630555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02cd3b06-fc67-4bec-b987-380b1dc8ee71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d598ceec17546c39b0361ca3cfb47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:11Z,use_quota=True,user_id='8597307fea774bc5b7a80da8c158955b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Creating volume 02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:11 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:11 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 1073741824 Apr 24 17:12:11 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1b42ac-df24-43c0-9f25-604489de518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2ea390-dd41-4211-b48c-3e290d19fead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:11 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Volume volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a (41831e24-32bb-4fe9-a657-9bc8cb67a83a): created successfully Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2ea390-dd41-4211-b48c-3e290d19fead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Flow 'volume_create_manager' (02c2ef32-569e-4190-a994-4db20c386ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:11 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-1c5bb8cf-a0f1-4a52-94c1-fd37579453bf tempest-VolumeQuotasAdminTestJSON-1802494709 None] Created volume successfully. Apr 24 17:12:11 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ff954c1-632b-4f18-b090-3bcb58699043" returned: 0 in 0.503s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-5ff954c1-632b-4f18-b090-3bcb58699043" released by "delete_volume" :: held 1.200s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Created reservations ['44beec89-b6b8-41a6-94b3-f61da1e4e8f2', 'ba40fbbd-18b3-4daa-abec-63a6cc59deba', 'ea00292f-9719-4f03-b676-4c14e3b21579', '5728acee-b784-4981-9346-44f8bd9d502b'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:12 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:12 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:12 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 1073741824" returned: 0 in 0.690s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:12 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 Apr 24 17:12:12 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:12 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.679s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:12 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Deleted volume successfully. Apr 24 17:12:12 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0c6768dc-f962-4f7f-b876-6f2eb34d14b8 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-5ff954c1-632b-4f18-b090-3bcb58699043-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:13 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3a9d613b-47d8-4f01-b57b-803136deeb97 tempest-VolumeQuotasAdminTestJSON-1365222397 None] Transfer volume completed successfully. Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-quobyte-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:13 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3" acquired by "delete_volume" :: waited 0.028s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71" returned: 0 in 0.800s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887fa00b-daf1-4227-94a9-c6810e2249c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304b3eba-9137-41c8-ad0a-517618bb298b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f765389f-7124-4add-9c47-01c2a24feda2]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:13 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Volume volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 (02cd3b06-fc67-4bec-b987-380b1dc8ee71): created successfully Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304b3eba-9137-41c8-ad0a-517618bb298b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Flow 'volume_create_manager' (919d2766-ddfc-407d-8df0-0eb12f388199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:13 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a5e5e76a-3dc1-4e98-9007-2e1b6df08774 tempest-VolumesSnapshotListTestJSON-1669428994 None] Created volume successfully. Apr 24 17:12:13 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3 Apr 24 17:12:13 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:13 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3" returned: 0 in 0.515s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:13 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3 Apr 24 17:12:13 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Acquiring lock "cinder-41831e24-32bb-4fe9-a657-9bc8cb67a83a-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:14 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3" returned: 0 in 0.721s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Lock "cinder-41831e24-32bb-4fe9-a657-9bc8cb67a83a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3" released by "delete_volume" :: held 1.329s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Acquiring lock "cinder-quobyte-41831e24-32bb-4fe9-a657-9bc8cb67a83a" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Lock "cinder-quobyte-41831e24-32bb-4fe9-a657-9bc8cb67a83a" acquired by "delete_volume" :: waited 0.033s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45036cc-7cc8-4234-aa4d-29e99abbb3af]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] Creating offline snapshot 7d13e803-94ef-4dbf-83bc-fc2932c8e108 of volume 02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e931ba-c507-44ed-9334-d456bb294b07]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Created reservations ['3b4f694d-a091-409d-9f30-5adf70861d84', 'cef91118-65a0-442c-a947-7fd288fc2a2a', 'eeef707c-9528-46ed-92e9-b705e0813a25', '59dd6ea4-b641-405d-a8de-d8f7d915dd8c'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:14 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a Apr 24 17:12:14 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:14 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 Apr 24 17:12:14 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:14 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:14 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:15 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a" returned: 0 in 0.612s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:15 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a Apr 24 17:12:15 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:15 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71" returned: 0 in 0.646s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:15 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 1G Apr 24 17:12:15 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-68c7f723-6616-468d-bd7f-14f7e6ec8603-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:15 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-68c7f723-6616-468d-bd7f-14f7e6ec8603-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.752s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:15 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Deleted volume successfully. Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d95e6de2-c20b-4615-98c4-fe0108bd4cc2 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-625d0a81-bc6a-4480-a3ed-3e2f90bf35a3-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-quobyte-68c7f723-6616-468d-bd7f-14f7e6ec8603" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-68c7f723-6616-468d-bd7f-14f7e6ec8603" acquired by "delete_volume" :: waited 0.025s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a7f69-6002-40d0-86ad-ad5ea62ac21c]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:15 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603 Apr 24 17:12:15 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:15 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-41831e24-32bb-4fe9-a657-9bc8cb67a83a" returned: 0 in 0.669s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Lock "cinder-quobyte-41831e24-32bb-4fe9-a657-9bc8cb67a83a" released by "delete_volume" :: held 1.327s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Created reservations ['5f4c950e-f3c0-433f-979a-96e4d762ffd5', '4609f941-9cd9-4a9b-b85e-2c2beb281744', '02f33d19-a8cc-409a-a06c-10c3f2f92db7', 'fd1e0901-ae22-4504-bed4-e9b19f54d96e'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:16 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:16 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:16 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 1G" returned: 0 in 0.843s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:16 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 Apr 24 17:12:16 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:16 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603" returned: 0 in 0.804s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:16 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603 Apr 24 17:12:16 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:16 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.726s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:16 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Deleted volume successfully. Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5e25127-9768-41a1-9f0c-9a600de5e55e tempest-VolumeQuotasAdminTestJSON-772864026 None] Lock "cinder-41831e24-32bb-4fe9-a657-9bc8cb67a83a-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:16 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108" returned: 0 in 0.774s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:16 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 is being set with open permissions: ugo+rw Apr 24 17:12:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:16 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 Apr 24 17:12:16 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:17 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-68c7f723-6616-468d-bd7f-14f7e6ec8603" returned: 0 in 0.754s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-68c7f723-6616-468d-bd7f-14f7e6ec8603" released by "delete_volume" :: held 1.614s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Created reservations ['39aac7ef-3b49-4677-9eeb-9edbd6bb2911', '30c246cb-8e02-45fe-88c4-4ae1ef158221', '3b272997-4812-476f-b431-eab3d81aa2d5', '2acebb3f-4cca-493f-9f8a-482496a83b8c'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:17 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:17 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:17 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108" returned: 0 in 0.548s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:17 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.info Apr 24 17:12:17 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-6d96c149-a0e5-4de2-9bff-58ca3c86f6ca-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-6d96c149-a0e5-4de2-9bff-58ca3c86f6ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-quobyte-5ad6390a-3dc1-474e-96be-09b386f0b0f7" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-5ad6390a-3dc1-474e-96be-09b386f0b0f7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-quobyte-6d96c149-a0e5-4de2-9bff-58ca3c86f6ca" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-6d96c149-a0e5-4de2-9bff-58ca3c86f6ca" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Deleting offline snapshot 6d96c149-a0e5-4de2-9bff-58ca3c86f6ca of volume 5ad6390a-3dc1-474e-96be-09b386f0b0f7 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] snapshot_file for this snap is: volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9072e30-4ec7-4d1f-b75e-6e22fa74e574]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:18 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca Apr 24 17:12:18 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:18 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.info" returned: 0 in 0.704s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:18 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.info is being set with open permissions: ugo+rw Apr 24 17:12:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:18 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.info Apr 24 17:12:18 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:18 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.971s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:18 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:18 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Deleted volume successfully. Apr 24 17:12:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-25ccb13f-cfab-4d09-af8a-94569155230f tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-68c7f723-6616-468d-bd7f-14f7e6ec8603-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:18 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca" returned: 0 in 0.805s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:12:18 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe641457-3afd-4e77-bbcc-d35a6b21aacd]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:18 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.info" returned: 0 in 0.594s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.230s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:18 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-455a0d94-ae26-43c9-ae01-cfc9e65f9398 tempest-VolumesSnapshotListTestJSON-1669428994 None] Create snapshot completed successfully Apr 24 17:12:18 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 Apr 24 17:12:18 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:19 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7" returned: 0 in 0.666s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:19 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca Apr 24 17:12:19 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:20 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=146,cinder:INSERT=43,cinder:UPDATE=249,cinder:DELETE=22 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:12:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] Creating offline snapshot 671f88f9-8f6b-4434-8558-f27eacdc4ff4 of volume 02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:12:20 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35156a4-baa6-44c7-b122-40cd69eb2dac]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:20 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 Apr 24 17:12:20 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:20 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca" returned: 0 in 0.973s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:20 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca Apr 24 17:12:20 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:21 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7.6d96c149-a0e5-4de2-9bff-58ca3c86f6ca" returned: 0 in 0.669s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-6d96c149-a0e5-4de2-9bff-58ca3c86f6ca" released by "_delete_snapshot" :: held 3.262s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-5ad6390a-3dc1-474e-96be-09b386f0b0f7" released by "delete_snapshot" :: held 3.296s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:21 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Created reservations ['9cd4fbd2-39f1-4b3b-b04a-55f3a89c69db', 'fd701938-3e33-4b88-b013-0d16682184dd', 'e7edf564-9d06-42d1-8425-531e68ec713e', '357027dc-efee-4def-9189-25e992ea6c71'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:21 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108" returned: 0 in 0.959s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:12:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:21 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 1G Apr 24 17:12:21 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:21 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Delete snapshot completed successfully. Apr 24 17:12:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-484a944e-63ab-4a07-8148-f0fdef581db1 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-6d96c149-a0e5-4de2-9bff-58ca3c86f6ca-delete_snapshot" released by "delete_snapshot" :: held 3.507s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:21 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 1G" returned: 0 in 0.769s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:22 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 Apr 24 17:12:22 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Flow 'volume_create_manager' (3e2120a8-6937-478e-8378-61027adc3272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47d6c89-7522-4eab-b58e-1371a519f997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47d6c89-7522-4eab-b58e-1371a519f997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1761227435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd3484d-413f-4b4c-b2bb-7ef350923fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ed64b136c74d3b8d72784a304a1a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:22Z,use_quota=True,user_id='a83bb0f0541c4d87854b6b2604343993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6272ef-6be0-43e9-9edb-38a8b2ff268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6272ef-6be0-43e9-9edb-38a8b2ff268f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cfcf38-0d3f-43ac-9b2b-5e644eddbeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cfcf38-0d3f-43ac-9b2b-5e644eddbeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd3484d-413f-4b4c-b2bb-7ef350923fb6', 'volume_name': 'volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171b510b-fdc5-4460-8fd1-f148b346a38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171b510b-fdc5-4460-8fd1-f148b346a38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c2403f-34ed-456e-97cb-bbe8e832d667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:22 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Volume dcd3484d-413f-4b4c-b2bb-7ef350923fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6', 'volume_size': 1} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-5ad6390a-3dc1-474e-96be-09b386f0b0f7-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-5ad6390a-3dc1-474e-96be-09b386f0b0f7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "cinder-quobyte-5ad6390a-3dc1-474e-96be-09b386f0b0f7" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-5ad6390a-3dc1-474e-96be-09b386f0b0f7" acquired by "delete_volume" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b6c354-58a1-47d6-82dc-02cb014d6c76]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:22 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 Apr 24 17:12:22 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:22 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4" returned: 0 in 0.639s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:22 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 is being set with open permissions: ugo+rw Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:22 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 Apr 24 17:12:22 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:22 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7" returned: 0 in 0.592s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:22 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7 Apr 24 17:12:22 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:23 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4" returned: 0 in 0.509s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.984s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.053s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1761227435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd3484d-413f-4b4c-b2bb-7ef350923fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ed64b136c74d3b8d72784a304a1a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:22Z,use_quota=True,user_id='a83bb0f0541c4d87854b6b2604343993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Creating volume dcd3484d-413f-4b4c-b2bb-7ef350923fb6 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:23 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:23 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 1073741824 Apr 24 17:12:23 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:23 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-fed7da5e-27f3-42ed-9a1e-561f33e8fd57 tempest-VolumesSnapshotListTestJSON-1669428994 None] Create snapshot completed successfully Apr 24 17:12:23 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5ad6390a-3dc1-474e-96be-09b386f0b0f7" returned: 0 in 0.530s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-quobyte-5ad6390a-3dc1-474e-96be-09b386f0b0f7" released by "delete_volume" :: held 1.212s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Created reservations ['ecf96304-a21b-4a97-8462-2fec635c9bf4', '399a72ab-2dad-4313-893e-7413762a4fcf', 'a02caf2d-4e69-498f-80e9-f9a5df64edb5', 'f9a2425c-15be-409c-8a62-275785148377'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:23 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:23 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:23 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 1073741824" returned: 0 in 0.758s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:24 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 Apr 24 17:12:24 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:24 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.575s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:24 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Deleted volume successfully. Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46e2eaeb-835c-4c51-a08e-d1530e48c601 tempest-CreateVolumesFromSnapshotTest-210681883 None] Lock "cinder-5ad6390a-3dc1-474e-96be-09b386f0b0f7-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Flow 'volume_create_manager' (46996e1d-2187-4914-998c-0cc2c49ec041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d266638-af92-41c2-89be-5c63ac115063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d266638-af92-41c2-89be-5c63ac115063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-14866508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6494ce6-4b54-41f4-a63a-161d81962b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb93a33bdb645c79d5d5f7abe56a637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:24Z,use_quota=True,user_id='c421c90978b44f2f878badb4337ef6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80c1440-f997-4467-ad4b-ee24f05cb70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80c1440-f997-4467-ad4b-ee24f05cb70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec1d777-7390-4c94-b656-ddfba290c30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec1d777-7390-4c94-b656-ddfba290c30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6494ce6-4b54-41f4-a63a-161d81962b1d', 'volume_name': 'volume-a6494ce6-4b54-41f4-a63a-161d81962b1d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c68c047-42a1-4e0d-acc6-43a645503582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c68c047-42a1-4e0d-acc6-43a645503582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b1299c-f506-4811-bc99-0fef552f6348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:24 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Volume a6494ce6-4b54-41f4-a63a-161d81962b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6494ce6-4b54-41f4-a63a-161d81962b1d', 'volume_size': 1} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:24 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" returned: 0 in 0.552s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.779s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] Creating offline snapshot 14bf4204-5b18-4241-81f8-7716a42da8bc of volume 02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c2403f-34ed-456e-97cb-bbe8e832d667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8117427d-4716-40dc-9f0e-b3f15cae22b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aad0cfe-cb9c-4fa8-ad4c-f794585efb09]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:24 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Volume volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 (dcd3484d-413f-4b4c-b2bb-7ef350923fb6): created successfully Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8117427d-4716-40dc-9f0e-b3f15cae22b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Flow 'volume_create_manager' (3e2120a8-6937-478e-8378-61027adc3272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:24 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-47575b93-ddda-46d2-aea8-400fc1373144 tempest-SnapshotDependencyTests-998667561 None] Created volume successfully. Apr 24 17:12:24 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 Apr 24 17:12:24 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:25 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4" returned: 0 in 0.628s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:12:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:25 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc 1G Apr 24 17:12:25 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:26 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc 1G" returned: 0 in 0.777s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:26 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc Apr 24 17:12:26 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:26 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc" returned: 0 in 0.478s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:26 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc is being set with open permissions: ugo+rw Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:26 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc Apr 24 17:12:26 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:26 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc" returned: 0 in 0.424s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.594s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-14866508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6494ce6-4b54-41f4-a63a-161d81962b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb93a33bdb645c79d5d5f7abe56a637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:24Z,use_quota=True,user_id='c421c90978b44f2f878badb4337ef6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Creating volume a6494ce6-4b54-41f4-a63a-161d81962b1d {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:26 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:27 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d 1073741824 Apr 24 17:12:27 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:27 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-bec6b69d-0802-49eb-8bb3-8af9e7b00bba tempest-VolumesSnapshotListTestJSON-1669428994 None] Create snapshot completed successfully Apr 24 17:12:27 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d 1073741824" returned: 0 in 0.631s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:27 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=169,cinder:INSERT=62,cinder:UPDATE=198,cinder:DELETE=16 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:12:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:27 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d Apr 24 17:12:27 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:28 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d" returned: 0 in 0.500s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.621s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b1299c-f506-4811-bc99-0fef552f6348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6494ce6-4b54-41f4-a63a-161d81962b1d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f83828-bdc3-434f-99cc-451e9578eeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] Creating offline snapshot 3ae7b5a9-d394-419a-9229-a563360f060c of volume dcd3484d-413f-4b4c-b2bb-7ef350923fb6 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:12:28 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Volume volume-a6494ce6-4b54-41f4-a63a-161d81962b1d (a6494ce6-4b54-41f4-a63a-161d81962b1d): created successfully Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f83828-bdc3-434f-99cc-451e9578eeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Flow 'volume_create_manager' (46996e1d-2187-4914-998c-0cc2c49ec041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcb3204-760a-46db-aec9-b0d77e726944]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:28 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9522192b-3b66-415e-a58c-cebd7d428213 tempest-AbsoluteLimitsTests-1733529961 None] Created volume successfully. Apr 24 17:12:28 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 Apr 24 17:12:28 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Acquiring lock "cinder-a6494ce6-4b54-41f4-a63a-161d81962b1d-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Lock "cinder-a6494ce6-4b54-41f4-a63a-161d81962b1d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "cinder-14bf4204-5b18-4241-81f8-7716a42da8bc-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Acquiring lock "cinder-quobyte-a6494ce6-4b54-41f4-a63a-161d81962b1d" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:28 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Lock "cinder-quobyte-a6494ce6-4b54-41f4-a63a-161d81962b1d" acquired by "delete_volume" :: waited 0.033s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-14bf4204-5b18-4241-81f8-7716a42da8bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" returned: 0 in 0.633s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58ad706-4adc-4d20-9f14-15b2a8ebe774]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:28 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c 1G Apr 24 17:12:28 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" acquired by "delete_snapshot" :: waited 0.044s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "cinder-quobyte-14bf4204-5b18-4241-81f8-7716a42da8bc" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-14bf4204-5b18-4241-81f8-7716a42da8bc" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Deleting offline snapshot 14bf4204-5b18-4241-81f8-7716a42da8bc of volume 02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] snapshot_file for this snap is: volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bd5cdc-7a73-43b8-8ab8-2014784da807]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:28 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d Apr 24 17:12:28 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:29 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc Apr 24 17:12:29 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:29 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d" returned: 0 in 0.609s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:29 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc" returned: 0 in 0.555s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:12:29 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d Apr 24 17:12:29 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:29 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1e4d2c-8910-4721-a83f-32aae6ccfc4d]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:29 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c 1G" returned: 0 in 0.670s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:29 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c Apr 24 17:12:29 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:29 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 Apr 24 17:12:29 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:29 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a6494ce6-4b54-41f4-a63a-161d81962b1d" returned: 0 in 0.497s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:29 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Lock "cinder-quobyte-a6494ce6-4b54-41f4-a63a-161d81962b1d" released by "delete_volume" :: held 1.169s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:30 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c" returned: 0 in 0.525s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:30 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c is being set with open permissions: ugo+rw Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:30 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4" returned: 0 in 0.559s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:30 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c Apr 24 17:12:30 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:30 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc Apr 24 17:12:30 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Created reservations ['6dc7fb44-936f-404e-9274-ddc7ad5bc50a', '3c720d9f-02d6-4f43-ae90-32016f4c699d', '6f86bed5-236f-43d9-9a87-704020865a8f', '9b16aabb-756a-48d3-bbd5-57c587061648'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:30 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:30 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:30 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c" returned: 0 in 0.448s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:30 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.info Apr 24 17:12:30 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:30 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.512s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:30 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Deleted volume successfully. Apr 24 17:12:30 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5e75b7c8-56e7-4dca-a0a8-a62b01bc3da8 tempest-AbsoluteLimitsTests-1733529961 None] Lock "cinder-a6494ce6-4b54-41f4-a63a-161d81962b1d-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc" returned: 0 in 0.644s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:30 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc Apr 24 17:12:30 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:31 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.info" returned: 0 in 0.527s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:31 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.info is being set with open permissions: ugo+rw Apr 24 17:12:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:31 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.info Apr 24 17:12:31 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:31 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.14bf4204-5b18-4241-81f8-7716a42da8bc" returned: 0 in 0.472s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-14bf4204-5b18-4241-81f8-7716a42da8bc" released by "_delete_snapshot" :: held 2.318s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" released by "delete_snapshot" :: held 2.339s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:31 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Created reservations ['49217a3d-7d76-4259-9741-66960aa14307', '7b577e37-14e3-4e96-9fc5-ce230d3a0887', '479adb36-f018-4fc6-a8f1-31ca38d026f0', '2bd40026-4d46-44b3-b5df-f092863925f4'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:31 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Delete snapshot completed successfully. Apr 24 17:12:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5788aeb0-2563-4972-ab77-f3e9a429e989 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-14bf4204-5b18-4241-81f8-7716a42da8bc-delete_snapshot" released by "delete_snapshot" :: held 2.514s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:31 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.info" returned: 0 in 0.492s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.421s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:31 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-95e00625-4776-48a5-a1f8-0967ff3ac305 tempest-SnapshotDependencyTests-998667561 None] Create snapshot completed successfully Apr 24 17:12:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "cinder-671f88f9-8f6b-4434-8558-f27eacdc4ff4-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-671f88f9-8f6b-4434-8558-f27eacdc4ff4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "cinder-quobyte-671f88f9-8f6b-4434-8558-f27eacdc4ff4" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-671f88f9-8f6b-4434-8558-f27eacdc4ff4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Deleting offline snapshot 671f88f9-8f6b-4434-8558-f27eacdc4ff4 of volume 02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] snapshot_file for this snap is: volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa8f7f4-136b-4812-9b63-32a32182388e]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:32 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 Apr 24 17:12:32 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Flow 'volume_create_manager' (9aa8d2dd-af33-4180-835a-31105f1628fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba60b82b-3593-434e-8d7c-4412efba4c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba60b82b-3593-434e-8d7c-4412efba4c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbdde31-d94f-4c27-b9bf-bd9d9d612e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ed64b136c74d3b8d72784a304a1a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ae7b5a9-d394-419a-9229-a563360f060c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:32Z,use_quota=True,user_id='a83bb0f0541c4d87854b6b2604343993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496ae847-7f59-4476-8c6a-fdcb488a0a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496ae847-7f59-4476-8c6a-fdcb488a0a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619b1b08-760a-4601-b11d-1bb5e8a50a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619b1b08-760a-4601-b11d-1bb5e8a50a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bcbdde31-d94f-4c27-b9bf-bd9d9d612e82', 'volume_name': 'volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82', 'volume_size': 1, 'snapshot_id': '3ae7b5a9-d394-419a-9229-a563360f060c'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f7d139-72e0-4d9e-8448-6b7788989b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f7d139-72e0-4d9e-8448-6b7788989b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbf1cfc-6707-46b5-88f5-a03cd679f305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:32 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Volume bcbdde31-d94f-4c27-b9bf-bd9d9d612e82: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82', 'volume_size': 1, 'snapshot_id': '3ae7b5a9-d394-419a-9229-a563360f060c'} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "cinder-quobyte-3ae7b5a9-d394-419a-9229-a563360f060c-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" by "_create_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-3ae7b5a9-d394-419a-9229-a563360f060c-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Creating volume bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 from snapshot 3ae7b5a9-d394-419a-9229-a563360f060c {{(pid=81986) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "cinder-quobyte-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] snapshot: 3ae7b5a9-d394-419a-9229-a563360f060c, volume: bcbdde31-d94f-4c27-b9bf-bd9d9d612e82, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7c4609-6fee-4d8c-8b0a-70ba4a69ab62]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:32 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c Apr 24 17:12:32 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:32 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4" returned: 0 in 0.722s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab6153c-d987-4714-81e2-08184e95ed36]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:32 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 Apr 24 17:12:32 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:33 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c" returned: 0 in 0.647s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bd6c7d-5596-48d3-85e6-41d199739e26]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:33 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 Apr 24 17:12:33 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:33 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108" returned: 0 in 0.651s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:33 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 Apr 24 17:12:33 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:33 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" returned: 0 in 0.683s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:12:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:33 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 Apr 24 17:12:33 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:34 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4" returned: 0 in 0.638s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:34 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4 Apr 24 17:12:34 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:34 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.671f88f9-8f6b-4434-8558-f27eacdc4ff4" returned: 0 in 0.590s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-671f88f9-8f6b-4434-8558-f27eacdc4ff4" released by "_delete_snapshot" :: held 2.746s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" released by "delete_snapshot" :: held 2.780s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:34 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Created reservations ['211fb76e-2b7b-4fe6-8537-b0bef3158c42', '43c30cc5-7801-4894-85d3-9a810a078e48', '2715a608-7f80-4ac7-afe5-361fbed89768', '02d8b02c-2e76-4007-99ff-68f574870491'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:35 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Delete snapshot completed successfully. Apr 24 17:12:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-0198e8a5-cd33-4501-a5ea-729702aa6713 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-671f88f9-8f6b-4434-8558-f27eacdc4ff4-delete_snapshot" released by "delete_snapshot" :: held 3.031s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "cinder-7d13e803-94ef-4dbf-83bc-fc2932c8e108-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-7d13e803-94ef-4dbf-83bc-fc2932c8e108-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" acquired by "delete_snapshot" :: waited 0.045s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "cinder-quobyte-7d13e803-94ef-4dbf-83bc-fc2932c8e108" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-7d13e803-94ef-4dbf-83bc-fc2932c8e108" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Deleting offline snapshot 7d13e803-94ef-4dbf-83bc-fc2932c8e108 of volume 02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:12:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] snapshot_file for this snap is: volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:12:35 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[39098971-d2e4-4243-a22d-7bdf5586428e]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:35 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 Apr 24 17:12:35 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:37 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108" returned: 0 in 1.889s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:37 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:12:37 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[37159b30-d3e8-4982-a7a2-9751f2828ccb]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:37 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 Apr 24 17:12:37 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:39 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71" returned: 0 in 1.696s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:39 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 Apr 24 17:12:39 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:39 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" returned: 0 in 5.955s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:39 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4ecfff-c771-4548-838e-83b9db5d884b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:39 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 Apr 24 17:12:39 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:40 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108" returned: 0 in 0.947s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:40 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108 Apr 24 17:12:40 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:40 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" returned: 0 in 0.682s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:40 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:12:40 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Converted 1024.00 MB image at 171.89 MB/s Apr 24 17:12:40 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 is being set with open permissions: ugo+rw Apr 24 17:12:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:40 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 Apr 24 17:12:40 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:40 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71.7d13e803-94ef-4dbf-83bc-fc2932c8e108" returned: 0 in 0.532s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:40 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-7d13e803-94ef-4dbf-83bc-fc2932c8e108" released by "_delete_snapshot" :: held 5.311s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:40 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" released by "delete_snapshot" :: held 5.392s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:40 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Created reservations ['309d1817-8902-4505-bc5a-3504d9e35064', 'a3c96408-93b0-4f00-8935-cf6190988f20', '12ceb29f-15a5-473d-b3bd-704d7835d064', '3a9cdce5-14b6-49c9-bb11-116208b3a001'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:41 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Delete snapshot completed successfully. Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-1002d22e-2bf6-424c-a927-3b6676e21589 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-7d13e803-94ef-4dbf-83bc-fc2932c8e108-delete_snapshot" released by "delete_snapshot" :: held 5.694s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:41 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" returned: 0 in 0.619s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" released by "_copy_volume_from_snapshot" :: held 8.697s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-3ae7b5a9-d394-419a-9229-a563360f060c-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" released by "_create_volume_from_snapshot" :: held 8.739s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.765s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbf1cfc-6707-46b5-88f5-a03cd679f305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82', 'volume_size': 1, 'snapshot_id': '3ae7b5a9-d394-419a-9229-a563360f060c'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d23ee31-d7ad-4774-987f-3a0484a7a70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:41 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Volume volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 (bcbdde31-d94f-4c27-b9bf-bd9d9d612e82): created successfully Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d23ee31-d7ad-4774-987f-3a0484a7a70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Flow 'volume_create_manager' (9aa8d2dd-af33-4180-835a-31105f1628fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:41 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d8c0adc3-4a0a-44b7-82b8-1533c8aa9469 tempest-SnapshotDependencyTests-998667561 None] Created volume successfully. Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "cinder-02cd3b06-fc67-4bec-b987-380b1dc8ee71-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-02cd3b06-fc67-4bec-b987-380b1dc8ee71-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" acquired by "delete_volume" :: waited 0.012s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f83fb0-56eb-4d8b-a4cc-5ff4b08053f6]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:42 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 Apr 24 17:12:42 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "cinder-3ae7b5a9-d394-419a-9229-a563360f060c-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-3ae7b5a9-d394-419a-9229-a563360f060c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "cinder-quobyte-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "cinder-quobyte-3ae7b5a9-d394-419a-9229-a563360f060c" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-3ae7b5a9-d394-419a-9229-a563360f060c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Deleting offline snapshot 3ae7b5a9-d394-419a-9229-a563360f060c of volume dcd3484d-413f-4b4c-b2bb-7ef350923fb6 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] snapshot_file for this snap is: volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff23035-dcab-49b1-8218-067ebe993a4b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:42 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c Apr 24 17:12:42 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:42 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71" returned: 0 in 0.623s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:42 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71 Apr 24 17:12:42 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:42 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c" returned: 0 in 0.617s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b7eaa9-0395-44bc-b98f-310ff3716ff9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:43 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 Apr 24 17:12:43 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:43 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-02cd3b06-fc67-4bec-b987-380b1dc8ee71" returned: 0 in 0.553s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-quobyte-02cd3b06-fc67-4bec-b987-380b1dc8ee71" released by "delete_volume" :: held 1.252s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Created reservations ['348c7cff-0505-4242-b3a6-8d6e9f74dd3d', '2b67d472-ce36-41e1-a5c4-1ce02799ac56', '2a22810c-0f18-407a-8add-adda45db0b36', 'b95cb529-3ef8-4d4f-8f16-a09a63433c5e'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:43 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:43 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:43 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" returned: 0 in 0.637s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:43 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c Apr 24 17:12:43 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:43 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.592s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:43 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Deleted volume successfully. Apr 24 17:12:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ce1679c3-4f66-4194-92a6-1214165f2c24 tempest-VolumesSnapshotListTestJSON-1669428994 None] Lock "cinder-02cd3b06-fc67-4bec-b987-380b1dc8ee71-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:44 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c" returned: 0 in 0.741s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:44 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c Apr 24 17:12:44 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:44 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6.3ae7b5a9-d394-419a-9229-a563360f060c" returned: 0 in 0.512s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-3ae7b5a9-d394-419a-9229-a563360f060c" released by "_delete_snapshot" :: held 2.664s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" released by "delete_snapshot" :: held 2.690s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:45 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Created reservations ['412e6314-1fd5-4934-b146-cc389460b0e3', 'fd74060f-3a5b-4a72-b9de-8019ac038127', 'bc352649-40f0-43a5-956f-bb407cc64160', '72dbd58f-84d1-4aa6-81c5-6d33ead82ea0'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:45 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Delete snapshot completed successfully. Apr 24 17:12:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-02767f39-5fc7-490e-8195-edf03cf766a4 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-3ae7b5a9-d394-419a-9229-a563360f060c-delete_snapshot" released by "delete_snapshot" :: held 2.884s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "cinder-dcd3484d-413f-4b4c-b2bb-7ef350923fb6-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-dcd3484d-413f-4b4c-b2bb-7ef350923fb6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "cinder-quobyte-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" acquired by "delete_volume" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:45 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f98726f-9cda-4fb4-93c7-ac43335297ec]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:45 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 Apr 24 17:12:45 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:46 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" returned: 0 in 0.860s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:46 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6 Apr 24 17:12:46 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:46 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Flow 'volume_create_manager' (d63d7661-cdb5-4163-a916-c3098965d7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bc5d30-8732-4906-928f-b72151c8f166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bc5d30-8732-4906-928f-b72151c8f166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064262334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184a5246-b469-4682-8a47-963604a707f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6422c7e08b884434a283748da811384f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:47Z,use_quota=True,user_id='70e7ad1f40bc4c3f9740d416c07266b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94dc0d96-638f-43c4-90fd-cfcce72a9feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94dc0d96-638f-43c4-90fd-cfcce72a9feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41085838-2763-4a5d-b0ea-8fd78f78abc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41085838-2763-4a5d-b0ea-8fd78f78abc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '184a5246-b469-4682-8a47-963604a707f5', 'volume_name': 'volume-184a5246-b469-4682-8a47-963604a707f5', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91f96e5-321a-4075-9bfc-9deea9c37159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91f96e5-321a-4075-9bfc-9deea9c37159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e937c337-7e63-4b57-b791-3827811cc360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Volume 184a5246-b469-4682-8a47-963604a707f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-184a5246-b469-4682-8a47-963604a707f5', 'volume_size': 1} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064262334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184a5246-b469-4682-8a47-963604a707f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6422c7e08b884434a283748da811384f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:47Z,use_quota=True,user_id='70e7ad1f40bc4c3f9740d416c07266b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Creating volume 184a5246-b469-4682-8a47-963604a707f5 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:47 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" returned: 0 in 0.586s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-dcd3484d-413f-4b4c-b2bb-7ef350923fb6" released by "delete_volume" :: held 1.525s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:47 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 1073741824 Apr 24 17:12:47 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Flow 'volume_create_manager' (79093c14-1f17-483b-b0d1-18c082208527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ead52fe-5253-49b7-a1b2-20a9dbd409e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ead52fe-5253-49b7-a1b2-20a9dbd409e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-765668961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7c85c0-85a7-4438-8c50-ade9b20246a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06227b0c39a848f0b2970dead428223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:47Z,use_quota=True,user_id='9d20aa4703074c02804ba43e2f01c7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f42abe-715d-4673-8cb0-65d14f6a80a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f42abe-715d-4673-8cb0-65d14f6a80a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31a8699-0f7d-4b28-8882-7eda646c8f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31a8699-0f7d-4b28-8882-7eda646c8f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af7c85c0-85a7-4438-8c50-ade9b20246a7', 'volume_name': 'volume-af7c85c0-85a7-4438-8c50-ade9b20246a7', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3564c8d-3f7c-4062-8674-c439eedff4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3564c8d-3f7c-4062-8674-c439eedff4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498a0ae2-f73d-4033-9b38-fb87f43a75b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Volume af7c85c0-85a7-4438-8c50-ade9b20246a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af7c85c0-85a7-4438-8c50-ade9b20246a7', 'volume_size': 1} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Created reservations ['47b5a999-837f-4267-ab1e-7cf27a0520e7', 'a27e4346-7085-4dcd-b22e-300492fde649', 'c636d2c6-1ade-473d-9977-98df41283eee', '6cd13e2f-19a1-43e9-b34b-0578a1de7763'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:47 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:47 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Flow 'volume_create_manager' (0f4a8422-3927-4388-bd71-b0efc46cbbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92d9510-33e5-4aab-a5fc-9115ae98c912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92d9510-33e5-4aab-a5fc-9115ae98c912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1900441524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf3af8a-977a-46fe-9f94-c75e9cb95be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06227b0c39a848f0b2970dead428223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:47Z,use_quota=True,user_id='9d20aa4703074c02804ba43e2f01c7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb5978f-f33d-4b0c-9fcd-ffdf1a2c041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb5978f-f33d-4b0c-9fcd-ffdf1a2c041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea298b4-cd64-4d02-b85e-c9f70a75e902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea298b4-cd64-4d02-b85e-c9f70a75e902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf3af8a-977a-46fe-9f94-c75e9cb95be4', 'volume_name': 'volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab64d4b-9bdc-4076-936a-1b5e6b783b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab64d4b-9bdc-4076-936a-1b5e6b783b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c41bf6-d9ce-46c8-b181-edb4f4687f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Volume 6bf3af8a-977a-46fe-9f94-c75e9cb95be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4', 'volume_size': 1} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Flow 'volume_create_manager' (f2bca235-3c9b-4796-a628-a8fa097fbab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96411bff-fb24-459c-832d-74109f4f08cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96411bff-fb24-459c-832d-74109f4f08cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-817823908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1744c200-b1f5-4a35-8c71-2dae620bfe75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06227b0c39a848f0b2970dead428223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:48Z,use_quota=True,user_id='9d20aa4703074c02804ba43e2f01c7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8534a3f-8901-4053-82e9-54cdc9a5894c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8534a3f-8901-4053-82e9-54cdc9a5894c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e6ce7d-d739-4e5e-b65b-6a5eb57aad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e6ce7d-d739-4e5e-b65b-6a5eb57aad89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1744c200-b1f5-4a35-8c71-2dae620bfe75', 'volume_name': 'volume-1744c200-b1f5-4a35-8c71-2dae620bfe75', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80b59f0-7a16-4ff5-8359-f89f652aa2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80b59f0-7a16-4ff5-8359-f89f652aa2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f992352-a4bf-45a5-859a-44bbaed6c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:47 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Volume 1744c200-b1f5-4a35-8c71-2dae620bfe75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1744c200-b1f5-4a35-8c71-2dae620bfe75', 'volume_size': 1} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:47 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 1073741824" returned: 0 in 0.782s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:47 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.548s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:47 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Deleted volume successfully. Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5fb220a2-df44-4e4f-806f-a8945d28ed1a tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-dcd3484d-413f-4b4c-b2bb-7ef350923fb6-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:47 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 Apr 24 17:12:47 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:47 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "cinder-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "cinder-quobyte-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" acquired by "delete_volume" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0e5004-474d-4cfd-b9dd-1e3744a9d827]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Flow 'volume_create_manager' (82f6f59f-f3fb-4798-aab6-10fe9e0ee334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd6e3e5-57c7-437e-82a4-2c54e413a9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd6e3e5-57c7-437e-82a4-2c54e413a9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728938923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06227b0c39a848f0b2970dead428223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:48Z,use_quota=True,user_id='9d20aa4703074c02804ba43e2f01c7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02deb668-6ab0-4cca-8bc2-d320ad9ec632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02deb668-6ab0-4cca-8bc2-d320ad9ec632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe8de2d-c36a-4e11-8a73-b57921f94e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe8de2d-c36a-4e11-8a73-b57921f94e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c', 'volume_name': 'volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:48 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 Apr 24 17:12:48 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e1be13-e1f3-4c62-b816-578ab7098d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e1be13-e1f3-4c62-b816-578ab7098d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629720d3-591f-49a1-a559-c928eb0ae929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:48 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Volume 6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c', 'volume_size': 1} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Flow 'volume_create_manager' (cb43fc98-46fd-42d0-baf1-22fc9d1ae906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d124cb0d-86cd-4287-bc3b-9d544a6596ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d124cb0d-86cd-4287-bc3b-9d544a6596ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76962283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937ad951-e54b-47b7-8d92-dd5112843b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06227b0c39a848f0b2970dead428223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:48Z,use_quota=True,user_id='9d20aa4703074c02804ba43e2f01c7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc855b00-f89c-4879-b6f6-f9c732601d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc855b00-f89c-4879-b6f6-f9c732601d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6f6149-4e72-4b18-bf99-6d7aa75babb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6f6149-4e72-4b18-bf99-6d7aa75babb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937ad951-e54b-47b7-8d92-dd5112843b37', 'volume_name': 'volume-937ad951-e54b-47b7-8d92-dd5112843b37', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:48 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9701f3-b360-4b41-a56b-5f8dfb300a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9701f3-b360-4b41-a56b-5f8dfb300a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80efd847-6baa-419e-a580-98fb8c052b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:48 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Volume 937ad951-e54b-47b7-8d92-dd5112843b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937ad951-e54b-47b7-8d92-dd5112843b37', 'volume_size': 1} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5" returned: 0 in 0.604s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.279s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-765668961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7c85c0-85a7-4438-8c50-ade9b20246a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06227b0c39a848f0b2970dead428223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:47Z,use_quota=True,user_id='9d20aa4703074c02804ba43e2f01c7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Creating volume af7c85c0-85a7-4438-8c50-ade9b20246a7 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:48 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e937c337-7e63-4b57-b791-3827811cc360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184a5246-b469-4682-8a47-963604a707f5', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e335c1d-db66-4076-8361-1946591f2eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:48 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7 1073741824 Apr 24 17:12:48 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:48 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Volume volume-184a5246-b469-4682-8a47-963604a707f5 (184a5246-b469-4682-8a47-963604a707f5): created successfully Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e335c1d-db66-4076-8361-1946591f2eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Flow 'volume_create_manager' (d63d7661-cdb5-4163-a916-c3098965d7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:48 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ba10f070-6b5f-4389-9e13-8beb96a684e4 tempest-VolumesActionsTest-1024365860 None] Created volume successfully. Apr 24 17:12:48 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" returned: 0 in 0.572s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:48 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82 Apr 24 17:12:48 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:49 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7 1073741824" returned: 0 in 0.653s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:49 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" returned: 0 in 0.524s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:49 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7 Apr 24 17:12:49 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-quobyte-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82" released by "delete_volume" :: held 1.148s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Created reservations ['9c132be4-6528-4a25-9537-1e72fac11d7e', 'bb219e5f-55c3-4836-a27c-b6be257ec538', '032761d4-f646-4e48-990f-7d5ad077214b', '0ff4f233-c9b9-43f1-96b8-ccaa1fdd7f37'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:49 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:49 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:49 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7" returned: 0 in 0.492s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1900441524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf3af8a-977a-46fe-9f94-c75e9cb95be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06227b0c39a848f0b2970dead428223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:47Z,use_quota=True,user_id='9d20aa4703074c02804ba43e2f01c7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Creating volume 6bf3af8a-977a-46fe-9f94-c75e9cb95be4 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:49 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:49 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4 1073741824 Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498a0ae2-f73d-4033-9b38-fb87f43a75b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7c85c0-85a7-4438-8c50-ade9b20246a7', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:49 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839d2605-6a38-44cf-ba6e-8e872424b7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:49 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Volume volume-af7c85c0-85a7-4438-8c50-ade9b20246a7 (af7c85c0-85a7-4438-8c50-ade9b20246a7): created successfully Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839d2605-6a38-44cf-ba6e-8e872424b7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Flow 'volume_create_manager' (79093c14-1f17-483b-b0d1-18c082208527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:49 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-44e29780-5c05-46c4-a7f3-c43f7cbaba2d tempest-CreateVolumesFromImageTest-829678576 None] Created volume successfully. Apr 24 17:12:49 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.516s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:49 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Deleted volume successfully. Apr 24 17:12:49 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5611e8a1-f834-4579-9de6-276e31710d11 tempest-SnapshotDependencyTests-998667561 None] Lock "cinder-bcbdde31-d94f-4c27-b9bf-bd9d9d612e82-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:50 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4 1073741824" returned: 0 in 0.716s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:50 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4 Apr 24 17:12:50 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:50 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4" returned: 0 in 0.514s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.142s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-817823908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1744c200-b1f5-4a35-8c71-2dae620bfe75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06227b0c39a848f0b2970dead428223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:48Z,use_quota=True,user_id='9d20aa4703074c02804ba43e2f01c7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Creating volume 1744c200-b1f5-4a35-8c71-2dae620bfe75 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:50 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c41bf6-d9ce-46c8-b181-edb4f4687f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d185cd90-2798-4f1f-bf4c-d9b66f6f6f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:51 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75 1073741824 Apr 24 17:12:51 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:51 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Volume volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4 (6bf3af8a-977a-46fe-9f94-c75e9cb95be4): created successfully Apr 24 17:12:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d185cd90-2798-4f1f-bf4c-d9b66f6f6f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Flow 'volume_create_manager' (0f4a8422-3927-4388-bd71-b0efc46cbbc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:51 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-321e554e-8fad-4711-a27b-d91b17a16b93 tempest-CreateVolumesFromImageTest-829678576 None] Created volume successfully. Apr 24 17:12:51 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75 1073741824" returned: 0 in 0.741s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:51 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75 Apr 24 17:12:51 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:52 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75" returned: 0 in 0.514s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.071s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728938923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06227b0c39a848f0b2970dead428223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:48Z,use_quota=True,user_id='9d20aa4703074c02804ba43e2f01c7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Creating volume 6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:52 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f992352-a4bf-45a5-859a-44bbaed6c837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1744c200-b1f5-4a35-8c71-2dae620bfe75', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb228eb2-33fe-4c74-88bd-e7d2e39e262e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:52 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c 1073741824 Apr 24 17:12:52 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:52 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Volume volume-1744c200-b1f5-4a35-8c71-2dae620bfe75 (1744c200-b1f5-4a35-8c71-2dae620bfe75): created successfully Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb228eb2-33fe-4c74-88bd-e7d2e39e262e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Flow 'volume_create_manager' (f2bca235-3c9b-4796-a628-a8fa097fbab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:52 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-166a6ba4-13b5-4394-ba5e-f4cacbb68908 tempest-CreateVolumesFromImageTest-829678576 None] Created volume successfully. Apr 24 17:12:53 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c 1073741824" returned: 0 in 0.784s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:53 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c Apr 24 17:12:53 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:53 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c" returned: 0 in 0.486s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.117s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76962283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937ad951-e54b-47b7-8d92-dd5112843b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06227b0c39a848f0b2970dead428223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:12:48Z,use_quota=True,user_id='9d20aa4703074c02804ba43e2f01c7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Creating volume 937ad951-e54b-47b7-8d92-dd5112843b37 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:12:53 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:53 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37 1073741824 Apr 24 17:12:53 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629720d3-591f-49a1-a559-c928eb0ae929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3755c2-ebf3-4af3-bb01-b9507711caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:53 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Volume volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c (6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c): created successfully Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3755c2-ebf3-4af3-bb01-b9507711caa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Flow 'volume_create_manager' (82f6f59f-f3fb-4798-aab6-10fe9e0ee334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:53 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-567b9afb-d9e3-4b4f-864a-93ba9aaaba3d tempest-CreateVolumesFromImageTest-829678576 None] Created volume successfully. Apr 24 17:12:54 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37 1073741824" returned: 0 in 0.729s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:54 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37 Apr 24 17:12:54 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:55 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37" returned: 0 in 0.638s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:12:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80efd847-6baa-419e-a580-98fb8c052b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937ad951-e54b-47b7-8d92-dd5112843b37', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c139ca52-fa91-47ab-956e-466c8074415d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:12:55 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Volume volume-937ad951-e54b-47b7-8d92-dd5112843b37 (937ad951-e54b-47b7-8d92-dd5112843b37): created successfully Apr 24 17:12:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c139ca52-fa91-47ab-956e-466c8074415d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:12:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Flow 'volume_create_manager' (cb43fc98-46fd-42d0-baf1-22fc9d1ae906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:12:55 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f00bd2f0-b9d7-43cd-a516-eef948a9abe4 tempest-CreateVolumesFromImageTest-829678576 None] Created volume successfully. Apr 24 17:12:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "cinder-937ad951-e54b-47b7-8d92-dd5112843b37-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-937ad951-e54b-47b7-8d92-dd5112843b37-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "cinder-quobyte-937ad951-e54b-47b7-8d92-dd5112843b37" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-quobyte-937ad951-e54b-47b7-8d92-dd5112843b37" acquired by "delete_volume" :: waited 0.033s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:56 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f1bd97-8d9b-4f0d-b4b4-34397c9f7236]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:56 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37 Apr 24 17:12:56 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:57 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37" returned: 0 in 0.618s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:57 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37 Apr 24 17:12:57 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:57 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-937ad951-e54b-47b7-8d92-dd5112843b37" returned: 0 in 0.515s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-quobyte-937ad951-e54b-47b7-8d92-dd5112843b37" released by "delete_volume" :: held 1.197s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:57 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Created reservations ['0f4a8645-7aa4-4774-b695-06cbdd8cb501', 'fa7caa91-5daf-40a9-ab86-a5bacbb93cf4', '568b6ed7-56f3-4fc8-96e6-1931faeec16e', 'a77023a4-c3a6-4e9c-97d1-ef8b1481ddff'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:12:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:12:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:12:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:12:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:12:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:12:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:57 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:12:57 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:58 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.453s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:58 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:12:58 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Deleted volume successfully. Apr 24 17:12:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9d0b0e64-dc72-41f6-95e9-308675679efe tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-937ad951-e54b-47b7-8d92-dd5112843b37-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "cinder-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "cinder-quobyte-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:12:58 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-quobyte-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:12:58 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19c221e-73a9-4c41-ba97-daef59412d4a]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:12:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:58 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c Apr 24 17:12:58 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:59 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c" returned: 0 in 0.674s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:12:59 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c Apr 24 17:12:59 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:12:59 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Apr 24 17:12:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c" returned: 0 in 0.534s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:12:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-quobyte-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c" released by "delete_volume" :: held 1.261s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:12:59 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Created reservations ['1e7d867a-9ef2-46a7-847c-51f04ac56990', '84342d66-322d-431b-8304-455d785b4d3e', '94a3bcdf-4996-4385-93dc-e3570278ce07', '30f01d99-476b-4304-b134-2809c4aaf8ce'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:00 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:13:00 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:00 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.604s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:13:00 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Deleted volume successfully. Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2bce8f62-d76f-4ee0-9464-467f99f58703 tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-6be8ca2d-0c1b-4e2d-9fa2-00b677885d3c-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "cinder-1744c200-b1f5-4a35-8c71-2dae620bfe75-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-1744c200-b1f5-4a35-8c71-2dae620bfe75-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "cinder-quobyte-1744c200-b1f5-4a35-8c71-2dae620bfe75" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-quobyte-1744c200-b1f5-4a35-8c71-2dae620bfe75" acquired by "delete_volume" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[36277adc-38da-4758-b21e-f0f4719f0e37]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:00 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75 Apr 24 17:13:00 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:01 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75" returned: 0 in 0.567s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:01 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75 Apr 24 17:13:01 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:01 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1744c200-b1f5-4a35-8c71-2dae620bfe75" returned: 0 in 0.481s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-quobyte-1744c200-b1f5-4a35-8c71-2dae620bfe75" released by "delete_volume" :: held 1.097s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Created reservations ['fbcd52ce-62d7-41b4-9fef-0439acc70775', 'e900bbf3-f1bb-4c0d-9c09-2755005d0e44', '11ebbea6-8926-40b1-b7f5-569061e756fa', 'e6f3ca65-eac3-449a-a72a-131aa4722b34'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:02 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:13:02 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:02 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.427s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:13:02 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Deleted volume successfully. Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-22502bf8-8c4a-4f31-adb2-2595d83e020b tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-1744c200-b1f5-4a35-8c71-2dae620bfe75-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:02 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:13:02 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "cinder-6bf3af8a-977a-46fe-9f94-c75e9cb95be4-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-6bf3af8a-977a-46fe-9f94-c75e9cb95be4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "cinder-quobyte-6bf3af8a-977a-46fe-9f94-c75e9cb95be4" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-quobyte-6bf3af8a-977a-46fe-9f94-c75e9cb95be4" acquired by "delete_volume" :: waited 0.045s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:03 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c398f0af-86cb-44d9-8f01-561c21a1453a]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:03 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4 Apr 24 17:13:03 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:03 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.680s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:13:03 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4" returned: 0 in 0.636s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:03 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4 Apr 24 17:13:03 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:04 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6bf3af8a-977a-46fe-9f94-c75e9cb95be4" returned: 0 in 0.518s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-quobyte-6bf3af8a-977a-46fe-9f94-c75e9cb95be4" released by "delete_volume" :: held 1.221s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:04 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Created reservations ['9ec3012d-5a9c-4f60-bc8a-8ff891317a43', '67673175-92bd-4b2c-b0fc-51f00272a271', '70c00179-9392-4476-ae34-7eb78fc02fc4', 'e0b674a0-0a88-45a1-8e89-c3e71cffa3d2'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:13:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:04 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:13:04 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:05 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.478s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:13:05 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Deleted volume successfully. Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-14083d9c-3dff-4780-a5b1-bcac003d7e2d tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-6bf3af8a-977a-46fe-9f94-c75e9cb95be4-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "cinder-af7c85c0-85a7-4438-8c50-ade9b20246a7-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-af7c85c0-85a7-4438-8c50-ade9b20246a7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "cinder-quobyte-af7c85c0-85a7-4438-8c50-ade9b20246a7" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-quobyte-af7c85c0-85a7-4438-8c50-ade9b20246a7" acquired by "delete_volume" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d7ec16-086d-4bef-92aa-76a319aba637]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-79a15f2b-61df-4c73-8786-c09b3bfbbe23 tempest-VolumesActionsTest-1024365860 None] Acquiring lock "cinder-184a5246-b469-4682-8a47-963604a707f5" by "attach_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:05 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7 Apr 24 17:13:05 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-79a15f2b-61df-4c73-8786-c09b3bfbbe23 tempest-VolumesActionsTest-1024365860 None] Lock "cinder-184a5246-b469-4682-8a47-963604a707f5" acquired by "attach_volume" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:05 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-79a15f2b-61df-4c73-8786-c09b3bfbbe23 tempest-VolumesActionsTest-1024365860 None] Attaching volume 184a5246-b469-4682-8a47-963604a707f5 to instance 84bf677a-578d-4c97-a81a-d5e3e06a7644 at mountpoint /dev/vdb on host None. Apr 24 17:13:05 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-79a15f2b-61df-4c73-8786-c09b3bfbbe23 tempest-VolumesActionsTest-1024365860 None] Attach volume completed successfully. Apr 24 17:13:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-79a15f2b-61df-4c73-8786-c09b3bfbbe23 tempest-VolumesActionsTest-1024365860 None] Lock "cinder-184a5246-b469-4682-8a47-963604a707f5" released by "attach_volume" :: held 0.136s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:06 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7" returned: 0 in 0.622s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:06 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7 Apr 24 17:13:06 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c3a6c05-09b5-4b57-bd8e-f96c54f9df0a tempest-VolumesActionsTest-1024365860 None] Acquiring lock "cinder-184a5246-b469-4682-8a47-963604a707f5-detach_volume" by "detach_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c3a6c05-09b5-4b57-bd8e-f96c54f9df0a tempest-VolumesActionsTest-1024365860 None] Lock "cinder-184a5246-b469-4682-8a47-963604a707f5-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:06 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3c3a6c05-09b5-4b57-bd8e-f96c54f9df0a tempest-VolumesActionsTest-1024365860 None] Detaching volume 184a5246-b469-4682-8a47-963604a707f5 from instance 84bf677a-578d-4c97-a81a-d5e3e06a7644. Apr 24 17:13:06 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3c3a6c05-09b5-4b57-bd8e-f96c54f9df0a tempest-VolumesActionsTest-1024365860 None] Detach volume completed successfully. Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c3a6c05-09b5-4b57-bd8e-f96c54f9df0a tempest-VolumesActionsTest-1024365860 None] Lock "cinder-184a5246-b469-4682-8a47-963604a707f5-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:06 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-af7c85c0-85a7-4438-8c50-ade9b20246a7" returned: 0 in 0.476s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-quobyte-af7c85c0-85a7-4438-8c50-ade9b20246a7" released by "delete_volume" :: held 1.156s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Created reservations ['27f08a88-6f16-4920-a8b0-ade9a1210712', '8871f570-d368-46fe-815b-b03c96b9779d', '52abf18f-8499-44ae-99d2-0511103fd70d', 'ee81fd17-777f-4d30-ba96-fc3e8bc94565'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:06 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:13:06 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:07 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.495s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:07 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:13:07 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Deleted volume successfully. Apr 24 17:13:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2f424d0d-9fcc-453b-930a-6d1f58386bb6 tempest-CreateVolumesFromImageTest-829678576 None] Lock "cinder-af7c85c0-85a7-4438-8c50-ade9b20246a7-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (14bd1c3a-079d-4c6a-a106-d5ebd7ec68b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a151b2c8-c250-46cf-87ec-d40e01206ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a151b2c8-c250-46cf-87ec-d40e01206ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440011295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff49d15-7a94-4697-a4b2-eb485c0a07cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:10Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf77d5c3-5bb0-4836-8dd4-b724187b5fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf77d5c3-5bb0-4836-8dd4-b724187b5fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d786560-70ba-4bd1-86d1-3546e100a950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d786560-70ba-4bd1-86d1-3546e100a950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bff49d15-7a94-4697-a4b2-eb485c0a07cc', 'volume_name': 'volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7205218-9460-42fc-a60f-c1cf46d5800d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7205218-9460-42fc-a60f-c1cf46d5800d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d8e1d0-1e9e-4543-98c3-ac02393ddfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:10 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume bff49d15-7a94-4697-a4b2-eb485c0a07cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc', 'volume_size': 1} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440011295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff49d15-7a94-4697-a4b2-eb485c0a07cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:10Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Creating volume bff49d15-7a94-4697-a4b2-eb485c0a07cc {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:13:10 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:13:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:10 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc 1073741824 Apr 24 17:13:10 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:11 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc 1073741824" returned: 0 in 0.619s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:11 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc Apr 24 17:13:11 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:11 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc" returned: 0 in 0.441s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:13:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d8e1d0-1e9e-4543-98c3-ac02393ddfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9e09d7-5e51-446f-9a53-9a5c881be676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:11 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc (bff49d15-7a94-4697-a4b2-eb485c0a07cc): created successfully Apr 24 17:13:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9e09d7-5e51-446f-9a53-9a5c881be676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (14bd1c3a-079d-4c6a-a106-d5ebd7ec68b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:11 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-6b5b62fd-411f-4d1b-ad35-c960a0886afa tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created volume successfully. Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (27ea0a9d-5b4f-4164-aeac-6ae2510d713a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e74826-9724-4efb-9247-cc8b56f14f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e74826-9724-4efb-9247-cc8b56f14f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-12253049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2255ae05-7461-4dee-a5c8-40cab5c1dc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:13Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d087c7-a7a0-4ee5-ba27-c0b273095e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d087c7-a7a0-4ee5-ba27-c0b273095e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0ce5b3-3dbb-4016-8d80-f478fe00360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0ce5b3-3dbb-4016-8d80-f478fe00360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2255ae05-7461-4dee-a5c8-40cab5c1dc93', 'volume_name': 'volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8034907d-ed49-4927-9f66-5987a0499635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8034907d-ed49-4927-9f66-5987a0499635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d676f2-4d31-4bc3-8c1e-27a3dd87056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:12 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume 2255ae05-7461-4dee-a5c8-40cab5c1dc93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93', 'volume_size': 1} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-12253049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2255ae05-7461-4dee-a5c8-40cab5c1dc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:13Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Creating volume 2255ae05-7461-4dee-a5c8-40cab5c1dc93 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:13:13 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:13 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93 1073741824 Apr 24 17:13:13 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (24f8cef3-0911-4341-ad6f-c5b24161db00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b78f9ba-f777-4288-a871-110c77b37a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b78f9ba-f777-4288-a871-110c77b37a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1254778928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5162449d-923b-4129-b21d-c3eb2e4d7f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:13Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dba2a1-4712-42dc-85ea-443deb6b1707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dba2a1-4712-42dc-85ea-443deb6b1707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96c0007-ebe4-4813-b119-fdc5f55c7b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96c0007-ebe4-4813-b119-fdc5f55c7b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5162449d-923b-4129-b21d-c3eb2e4d7f0d', 'volume_name': 'volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a427d04-ec72-4a9c-aac0-b1ba5b0fed76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a427d04-ec72-4a9c-aac0-b1ba5b0fed76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243adde9-7b84-4eba-a683-91fffe95c96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume 5162449d-923b-4129-b21d-c3eb2e4d7f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d', 'volume_size': 1} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (23e6ae1d-0759-4bc0-9a1b-be246f5bcf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c749f7-4103-42f2-8e1f-80a0160a67ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c749f7-4103-42f2-8e1f-80a0160a67ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953056765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41f09b5-c793-4123-9f34-c5f31ec1dd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:13Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f60522-17fd-469f-861c-f0b28db350f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f60522-17fd-469f-861c-f0b28db350f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896601e9-a60c-4b4e-aa99-d1ce220c74b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896601e9-a60c-4b4e-aa99-d1ce220c74b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f41f09b5-c793-4123-9f34-c5f31ec1dd9f', 'volume_name': 'volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f8dd76-205d-4e72-be03-dfe0f8c8f771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f8dd76-205d-4e72-be03-dfe0f8c8f771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa326e15-8d69-42b1-af66-988fd0d49cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume f41f09b5-c793-4123-9f34-c5f31ec1dd9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f', 'volume_size': 1} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (d95b09dc-8592-4872-a9ba-8ad20dedc47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdaa072-59d2-4cd8-9613-2f17ecefb88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdaa072-59d2-4cd8-9613-2f17ecefb88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1629931768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10919ccc-39b0-4de2-aedf-5eb4e9b9a184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:14Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92aa1ae-6993-413f-bf5b-d620adbf8cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92aa1ae-6993-413f-bf5b-d620adbf8cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc5a211-7dd3-4933-a274-01530613e10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc5a211-7dd3-4933-a274-01530613e10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10919ccc-39b0-4de2-aedf-5eb4e9b9a184', 'volume_name': 'volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab32d84-9661-4c9e-b8b1-845f1bdf3e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab32d84-9661-4c9e-b8b1-845f1bdf3e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e981fb-fdc6-4251-9e58-ea6ae1eb24e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:13 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume 10919ccc-39b0-4de2-aedf-5eb4e9b9a184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184', 'volume_size': 1} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:13 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93 1073741824" returned: 0 in 0.800s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:13 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93 Apr 24 17:13:13 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (9c2ad5ee-90b0-49b1-aba2-b5228e78c552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa63083-69d6-4e8d-a375-e6f7186b81d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa63083-69d6-4e8d-a375-e6f7186b81d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2117194709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42272d0-8422-4f75-a783-1d1deb3d39af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:14Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd01d02c-9ea0-41e0-ab04-a1b9258e86ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd01d02c-9ea0-41e0-ab04-a1b9258e86ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c0f010-b8d0-4738-8a07-828bacd76e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c0f010-b8d0-4738-8a07-828bacd76e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42272d0-8422-4f75-a783-1d1deb3d39af', 'volume_name': 'volume-f42272d0-8422-4f75-a783-1d1deb3d39af', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25f2352-4878-4a6f-b4d0-a6416244dec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25f2352-4878-4a6f-b4d0-a6416244dec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c482c93-4d8d-4b3b-a372-d792d6aaac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:14 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume f42272d0-8422-4f75-a783-1d1deb3d39af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42272d0-8422-4f75-a783-1d1deb3d39af', 'volume_size': 1} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:14 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93" returned: 0 in 0.489s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.101s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1254778928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5162449d-923b-4129-b21d-c3eb2e4d7f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:13Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Creating volume 5162449d-923b-4129-b21d-c3eb2e4d7f0d {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:13:14 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d676f2-4d31-4bc3-8c1e-27a3dd87056e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:14 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d 1073741824 Apr 24 17:13:14 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ba58c2-5f20-492d-a23f-674c9d5f5a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:14 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93 (2255ae05-7461-4dee-a5c8-40cab5c1dc93): created successfully Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ba58c2-5f20-492d-a23f-674c9d5f5a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:14 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (27ea0a9d-5b4f-4164-aeac-6ae2510d713a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:14 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-fe505fe8-f419-4b5c-b051-032aefb11d09 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created volume successfully. Apr 24 17:13:15 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d 1073741824" returned: 0 in 0.657s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:15 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d Apr 24 17:13:15 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:15 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d" returned: 0 in 0.459s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.956s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953056765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41f09b5-c793-4123-9f34-c5f31ec1dd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:13Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Creating volume f41f09b5-c793-4123-9f34-c5f31ec1dd9f {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:13:15 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:15 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f 1073741824 Apr 24 17:13:15 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243adde9-7b84-4eba-a683-91fffe95c96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25afaa8a-48a1-413d-a21d-00c033046f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:15 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d (5162449d-923b-4129-b21d-c3eb2e4d7f0d): created successfully Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25afaa8a-48a1-413d-a21d-00c033046f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (24f8cef3-0911-4341-ad6f-c5b24161db00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:15 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d92fc577-4bb6-428d-92dd-310d178b93fe tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created volume successfully. Apr 24 17:13:16 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f 1073741824" returned: 0 in 0.643s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:16 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f Apr 24 17:13:16 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:16 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f" returned: 0 in 0.432s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.874s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1629931768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10919ccc-39b0-4de2-aedf-5eb4e9b9a184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:14Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Creating volume 10919ccc-39b0-4de2-aedf-5eb4e9b9a184 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:13:16 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:16 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184 1073741824 Apr 24 17:13:16 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa326e15-8d69-42b1-af66-988fd0d49cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a101c537-ed03-4dbd-9e91-c6e007cebf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:16 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f (f41f09b5-c793-4123-9f34-c5f31ec1dd9f): created successfully Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a101c537-ed03-4dbd-9e91-c6e007cebf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (23e6ae1d-0759-4bc0-9a1b-be246f5bcf0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:16 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-323229ee-dd6d-44ab-9b7b-76209f6380c3 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created volume successfully. Apr 24 17:13:17 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184 1073741824" returned: 0 in 0.633s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:17 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184 Apr 24 17:13:17 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:17 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184" returned: 0 in 0.421s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.667s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2117194709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42272d0-8422-4f75-a783-1d1deb3d39af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb27ddb614d945c2b408d52a4e244928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:13:14Z,use_quota=True,user_id='8c02751ace1f4d5db5b0a3fe27c3552f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Creating volume f42272d0-8422-4f75-a783-1d1deb3d39af {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:13:17 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e981fb-fdc6-4251-9e58-ea6ae1eb24e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:17 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af 1073741824 Apr 24 17:13:17 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec72780-f1ac-4718-acb2-be759eae5bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:17 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184 (10919ccc-39b0-4de2-aedf-5eb4e9b9a184): created successfully Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec72780-f1ac-4718-acb2-be759eae5bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (d95b09dc-8592-4872-a9ba-8ad20dedc47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:17 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-63ccd2bc-3978-4c80-9e35-d5b5eecc7be9 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created volume successfully. Apr 24 17:13:18 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af 1073741824" returned: 0 in 0.632s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:18 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af Apr 24 17:13:18 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:18 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af" returned: 0 in 0.422s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:13:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:18 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c482c93-4d8d-4b3b-a372-d792d6aaac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42272d0-8422-4f75-a783-1d1deb3d39af', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:18 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a8f72f-1bc7-410e-abda-d39cbd0e8257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:13:18 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Volume volume-f42272d0-8422-4f75-a783-1d1deb3d39af (f42272d0-8422-4f75-a783-1d1deb3d39af): created successfully Apr 24 17:13:18 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a8f72f-1bc7-410e-abda-d39cbd0e8257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:13:18 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Flow 'volume_create_manager' (9c2ad5ee-90b0-49b1-aba2-b5228e78c552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:13:18 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e479ccf6-1da8-44e9-a78d-b7028e3fa727 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created volume successfully. Apr 24 17:13:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-f42272d0-8422-4f75-a783-1d1deb3d39af-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-f42272d0-8422-4f75-a783-1d1deb3d39af-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-quobyte-f42272d0-8422-4f75-a783-1d1deb3d39af" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:19 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-f42272d0-8422-4f75-a783-1d1deb3d39af" acquired by "delete_volume" :: waited 0.028s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:19 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afe015e-198a-4023-a2da-4cbc2bf6af34]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:19 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af Apr 24 17:13:19 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:20 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af" returned: 0 in 0.596s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:20 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af Apr 24 17:13:20 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:20 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f42272d0-8422-4f75-a783-1d1deb3d39af" returned: 0 in 0.565s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-f42272d0-8422-4f75-a783-1d1deb3d39af" released by "delete_volume" :: held 1.207s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=130,cinder:INSERT=42,cinder:UPDATE=156,cinder:DELETE=17 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created reservations ['48fbf079-b2e1-43a8-afe2-b7e56b4c4c0f', '54870211-a9b0-4e2b-adba-5515d8909d39', 'ff106710-9fe0-4679-93e0-ff29d3d4f544', 'eff7e2e9-f366-4f94-9a24-417ee2f471cf'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:21 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:13:21 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:21 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.441s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:21 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:13:21 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Deleted volume successfully. Apr 24 17:13:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-aa5bec7a-6557-41e1-9d46-275e15697b9a tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-f42272d0-8422-4f75-a783-1d1deb3d39af-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-10919ccc-39b0-4de2-aedf-5eb4e9b9a184-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-10919ccc-39b0-4de2-aedf-5eb4e9b9a184-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-quobyte-10919ccc-39b0-4de2-aedf-5eb4e9b9a184" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:21 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-10919ccc-39b0-4de2-aedf-5eb4e9b9a184" acquired by "delete_volume" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:21 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6ab707-52d3-4691-9e3e-8486d93c321a]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:21 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184 Apr 24 17:13:21 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:22 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184" returned: 0 in 0.499s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:22 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184 Apr 24 17:13:22 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:22 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10919ccc-39b0-4de2-aedf-5eb4e9b9a184" returned: 0 in 0.466s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-10919ccc-39b0-4de2-aedf-5eb4e9b9a184" released by "delete_volume" :: held 1.005s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:22 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created reservations ['74f02e52-6dea-4671-8eb5-17fea325115c', '6c1b2448-f489-4e3d-9e02-6cb4dc3b54cc', '2f740ced-5cb8-4227-8c9a-fad0f6e4ac69', '2b2eeca8-6a98-42a5-b579-28c0db203175'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:13:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:23 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:13:23 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:23 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.448s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:23 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:13:23 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Deleted volume successfully. Apr 24 17:13:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-3c2bb7e3-6d16-4003-954e-72d0872b8666 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-10919ccc-39b0-4de2-aedf-5eb4e9b9a184-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-f41f09b5-c793-4123-9f34-c5f31ec1dd9f-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-f41f09b5-c793-4123-9f34-c5f31ec1dd9f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-quobyte-f41f09b5-c793-4123-9f34-c5f31ec1dd9f" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-f41f09b5-c793-4123-9f34-c5f31ec1dd9f" acquired by "delete_volume" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:24 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[62caf0c9-a6d0-41e2-a562-90991b921375]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:24 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f Apr 24 17:13:24 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:24 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f" returned: 0 in 0.551s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:24 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f Apr 24 17:13:24 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:25 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-f41f09b5-c793-4123-9f34-c5f31ec1dd9f" returned: 0 in 0.448s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-f41f09b5-c793-4123-9f34-c5f31ec1dd9f" released by "delete_volume" :: held 1.069s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created reservations ['cf6a1e16-3d66-4529-9b57-dc43d2ded002', '6589b003-0565-43c2-a711-429df53f7d34', '457a8c5a-9d4c-4eb4-9f5a-45b639a53a9b', '84250157-afbc-4d24-a562-8dccc5d7f470'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:25 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:13:25 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:25 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.433s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:13:25 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Deleted volume successfully. Apr 24 17:13:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-eb57dd37-04f2-49f8-bc70-d790f2b2787f tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-f41f09b5-c793-4123-9f34-c5f31ec1dd9f-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-5162449d-923b-4129-b21d-c3eb2e4d7f0d-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-5162449d-923b-4129-b21d-c3eb2e4d7f0d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-quobyte-5162449d-923b-4129-b21d-c3eb2e4d7f0d" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-5162449d-923b-4129-b21d-c3eb2e4d7f0d" acquired by "delete_volume" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:26 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2e13d2-efd0-45e8-9d07-b0043829df95]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:26 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d Apr 24 17:13:26 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:26 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d" returned: 0 in 0.628s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:26 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d Apr 24 17:13:26 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:27 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-5162449d-923b-4129-b21d-c3eb2e4d7f0d" returned: 0 in 0.580s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-5162449d-923b-4129-b21d-c3eb2e4d7f0d" released by "delete_volume" :: held 1.256s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:27 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created reservations ['6aefa480-5678-4046-b870-795f27d7a065', '45d0cb53-5f13-45ad-b358-fe403727a873', '8ac07f4a-cd89-498b-8cea-209921c4f688', 'a1e755e6-3583-4e9c-a609-cb3c5d047421'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:13:27 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:UPDATE=162,cinder:SELECT=116,cinder:DELETE=11,cinder:INSERT=41 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:13:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:27 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:13:27 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:28 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.520s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:28 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:13:28 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Deleted volume successfully. Apr 24 17:13:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9216463b-9f3d-48f2-98e0-cbbad68efb16 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-5162449d-923b-4129-b21d-c3eb2e4d7f0d-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-2255ae05-7461-4dee-a5c8-40cab5c1dc93-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-2255ae05-7461-4dee-a5c8-40cab5c1dc93-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-quobyte-2255ae05-7461-4dee-a5c8-40cab5c1dc93" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-2255ae05-7461-4dee-a5c8-40cab5c1dc93" acquired by "delete_volume" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[2762e000-787f-4c2a-948a-8e341d47b5f4]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:28 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93 Apr 24 17:13:28 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:29 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93" returned: 0 in 0.787s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:29 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93 Apr 24 17:13:29 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:29 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-2255ae05-7461-4dee-a5c8-40cab5c1dc93" returned: 0 in 0.493s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:29 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-2255ae05-7461-4dee-a5c8-40cab5c1dc93" released by "delete_volume" :: held 1.330s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:29 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created reservations ['f0fd6dd0-da48-4d3e-9f54-da340edcd330', '939d7b2d-af82-4613-872a-6872c10b20d7', 'b5a4a244-9441-497c-a7aa-7795e3f3b04c', 'e574e91a-c959-45d7-9ec2-a87fb4ad016c'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:13:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:30 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:13:30 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:30 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.442s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:13:30 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Deleted volume successfully. Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-84a376e8-a2db-4088-80be-7ff8d6e5a06b tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-2255ae05-7461-4dee-a5c8-40cab5c1dc93-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c7a9e9d7-8985-4d44-ae29-6ba978db63d4 tempest-VolumesActionsTest-1024365860 None] Acquiring lock "cinder-184a5246-b469-4682-8a47-963604a707f5" by "attach_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c7a9e9d7-8985-4d44-ae29-6ba978db63d4 tempest-VolumesActionsTest-1024365860 None] Lock "cinder-184a5246-b469-4682-8a47-963604a707f5" acquired by "attach_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:30 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-c7a9e9d7-8985-4d44-ae29-6ba978db63d4 tempest-VolumesActionsTest-1024365860 None] Attaching volume 184a5246-b469-4682-8a47-963604a707f5 to instance f4f58a15-ca5d-4ab5-9b4f-b69ee5778357 at mountpoint /dev/vdb on host None. Apr 24 17:13:30 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-c7a9e9d7-8985-4d44-ae29-6ba978db63d4 tempest-VolumesActionsTest-1024365860 None] Attach volume completed successfully. Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c7a9e9d7-8985-4d44-ae29-6ba978db63d4 tempest-VolumesActionsTest-1024365860 None] Lock "cinder-184a5246-b469-4682-8a47-963604a707f5" released by "attach_volume" :: held 0.102s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-bff49d15-7a94-4697-a4b2-eb485c0a07cc-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-bff49d15-7a94-4697-a4b2-eb485c0a07cc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "cinder-quobyte-bff49d15-7a94-4697-a4b2-eb485c0a07cc" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-bff49d15-7a94-4697-a4b2-eb485c0a07cc" acquired by "delete_volume" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd55906-7928-4dd7-aca2-550e4634aa11]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:30 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc Apr 24 17:13:30 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-860e7148-64b0-4eee-bcde-2165281ff649 tempest-VolumesActionsTest-1024365860 None] Acquiring lock "cinder-184a5246-b469-4682-8a47-963604a707f5-detach_volume" by "detach_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:13:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-860e7148-64b0-4eee-bcde-2165281ff649 tempest-VolumesActionsTest-1024365860 None] Lock "cinder-184a5246-b469-4682-8a47-963604a707f5-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:13:31 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-860e7148-64b0-4eee-bcde-2165281ff649 tempest-VolumesActionsTest-1024365860 None] Detaching volume 184a5246-b469-4682-8a47-963604a707f5 from instance f4f58a15-ca5d-4ab5-9b4f-b69ee5778357. Apr 24 17:13:31 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-860e7148-64b0-4eee-bcde-2165281ff649 tempest-VolumesActionsTest-1024365860 None] Detach volume completed successfully. Apr 24 17:13:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-860e7148-64b0-4eee-bcde-2165281ff649 tempest-VolumesActionsTest-1024365860 None] Lock "cinder-184a5246-b469-4682-8a47-963604a707f5-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:31 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc" returned: 0 in 0.625s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:31 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc Apr 24 17:13:31 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:31 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-bff49d15-7a94-4697-a4b2-eb485c0a07cc" returned: 0 in 0.502s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-quobyte-bff49d15-7a94-4697-a4b2-eb485c0a07cc" released by "delete_volume" :: held 1.200s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:32 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Created reservations ['6153fcaa-d256-4be0-a9f3-81704c0a93c8', '0b7af16a-2f46-4ff2-a3f1-b7d2b0e20b57', '618f0ab0-1908-4c5c-b9e8-382cd57b0001', '2c777c0b-8551-4074-997f-5b2ca043eb72'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:13:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:13:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:13:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:13:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:32 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:13:32 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:32 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.451s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:32 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:13:32 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Deleted volume successfully. Apr 24 17:13:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-74dc09c5-71c4-4688-a269-4f538ae07c88 tempest-CreateVolumesFromSourceVolumeTest-1810179048 None] Lock "cinder-bff49d15-7a94-4697-a4b2-eb485c0a07cc-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:13:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:13:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:13:40 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f70e686-532e-452f-b8e7-c79ada35c024]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:40 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 Apr 24 17:13:40 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:41 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5" returned: 0 in 0.492s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:41 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfcc903-2abd-443d-b138-9c4a449ebc2e]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:41 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 Apr 24 17:13:41 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:41 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5" returned: 0 in 0.503s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.8bfabab2-62c9-4881-a679-5dc25d06814cut2648m0.img {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:41 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.8bfabab2-62c9-4881-a679-5dc25d06814cut2648m0.img Apr 24 17:13:41 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:42 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:INSERT=8,cinder:UPDATE=63,cinder:SELECT=35,cinder:DELETE=2 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:13:46 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.8bfabab2-62c9-4881-a679-5dc25d06814cut2648m0.img" returned: 0 in 4.152s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:46 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2679d49-ad80-432a-8f59-b9b80343365d]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:13:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:13:46 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 Apr 24 17:13:46 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:13:46 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 24 17:13:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5" returned: 0 in 0.609s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:13:46 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5, size 1024.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.8bfabab2-62c9-4881-a679-5dc25d06814cut2648m0.img {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:13:46 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] Converted 1024.00 MB image at 246.54 MB/s Apr 24 17:13:46 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] 8bfabab2-62c9-4881-a679-5dc25d06814c was raw, no need to convert to raw {{(pid=81986) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 24 17:13:56 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:DELETE=2,cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=15 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:13:56 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=1 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:14:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 20.661s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] Uploaded volume to glance image-id: 8bfabab2-62c9-4881-a679-5dc25d06814c. {{(pid=81986) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 17:14:01 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-65bf6b21-51d3-4df9-9f91-41f14c1fdde6 tempest-VolumesActionsTest-1024365860 None] Copy volume to image completed successfully. Apr 24 17:14:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:14:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:14:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:14:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:02 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:14:02 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:03 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe024fa-8e70-4846-b39f-09084962071b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:03 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.502s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:14:03 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 Apr 24 17:14:03 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:03 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5" returned: 0 in 0.537s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:03 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0c0342-ac5f-4bba-a349-64c2ca274396]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:04 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 Apr 24 17:14:04 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:04 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5" returned: 0 in 0.524s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:04 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img Apr 24 17:14:04 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:08 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img" returned: 0 in 4.294s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:08 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e44820-5e07-4c4b-a5be-371a4b758a7b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:08 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 Apr 24 17:14:08 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:09 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5" returned: 0 in 0.607s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:09 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5, size 1024.00 MB, duration 4.30 sec, destination /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:14:09 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Converted 1024.00 MB image at 238.35 MB/s Apr 24 17:14:09 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] f7dbdc52-b49a-4196-aa3f-6693b4237a4f was raw, converting to qcow2 {{(pid=81986) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 24 17:14:09 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68fec53-0a44-4632-a258-16d106b2fc18]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:09 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img Apr 24 17:14:09 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:09 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img" returned: 0 in 0.465s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:09 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img Apr 24 17:14:09 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:10 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img" returned: 1 in 0.466s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:14:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img /opt/stack/data/cinder/conversion/vol_upload_kwnt4max {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:10 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img /opt/stack/data/cinder/conversion/vol_upload_kwnt4max Apr 24 17:14:10 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:10 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img /opt/stack/data/cinder/conversion/vol_upload_kwnt4max" returned: 0 in 0.429s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:10 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Image conversion details: src /opt/stack/data/cinder/conversion/184a5246-b469-4682-8a47-963604a707f5.temp_image.f7dbdc52-b49a-4196-aa3f-6693b4237a4f87tmx3mq.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kwnt4max {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:14:10 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 24 17:14:10 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67ed2b0-10b6-4ec0-ad37-3892861f1f6f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kwnt4max {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:10 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kwnt4max Apr 24 17:14:10 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:11 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kwnt4max" returned: 0 in 0.453s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.955s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:12 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Uploaded volume to glance image-id: f7dbdc52-b49a-4196-aa3f-6693b4237a4f. {{(pid=81986) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 17:14:12 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2f921e6b-ac6b-4397-a08c-eef7f17656bf tempest-VolumesActionsTest-1024365860 None] Copy volume to image completed successfully. Apr 24 17:14:13 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Acquiring lock "cinder-184a5246-b469-4682-8a47-963604a707f5-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:14:13 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Lock "cinder-184a5246-b469-4682-8a47-963604a707f5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:14:13 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Acquiring lock "cinder-quobyte-184a5246-b469-4682-8a47-963604a707f5" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:14:13 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Lock "cinder-quobyte-184a5246-b469-4682-8a47-963604a707f5" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:14:13 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a8b8f3-9cad-40b0-a7aa-78c0da7b527e]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:13 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 Apr 24 17:14:13 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:13 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5" returned: 0 in 0.520s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:13 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5 Apr 24 17:14:13 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:14 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-184a5246-b469-4682-8a47-963604a707f5" returned: 0 in 0.460s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Lock "cinder-quobyte-184a5246-b469-4682-8a47-963604a707f5" released by "delete_volume" :: held 1.024s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Created reservations ['5c6138d3-d220-4a95-826c-3d7ff08157db', '03395a74-f246-431f-a50a-47c9e10e4c97', '2e92005a-6dc6-4008-8998-aa83897d548c', '13f7c96d-810b-4e89-9a3b-48cacccf30cf'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:14 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:14:14 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:14 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.435s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:14:14 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Deleted volume successfully. Apr 24 17:14:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-59443fef-fc21-4380-af86-edb96c697d39 tempest-VolumesActionsTest-1024365860 None] Lock "cinder-184a5246-b469-4682-8a47-963604a707f5-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Flow 'volume_create_manager' (8143f721-2383-43ce-ab24-b77a6e95e668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb53a597-ea35-49f9-8af9-651e3a770418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb53a597-ea35-49f9-8af9-651e3a770418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-793370117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7561cc-92c6-4a81-9199-ba17d2bb0cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21af6bef9e7b44f19369e13763adf57c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:14:20Z,use_quota=True,user_id='f27650fc64ff4d838839f66268283409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc17975-fd80-4944-ba07-57832b7b5568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc17975-fd80-4944-ba07-57832b7b5568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0c7e0a-0fc0-45c4-96dc-fd2b56100e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0c7e0a-0fc0-45c4-96dc-fd2b56100e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d7561cc-92c6-4a81-9199-ba17d2bb0cad', 'volume_name': 'volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314420e2-8c05-4688-9039-e5b5a5cff8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314420e2-8c05-4688-9039-e5b5a5cff8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af44627b-6f9e-425e-84d1-46e710ad2bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:20 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Volume 3d7561cc-92c6-4a81-9199-ba17d2bb0cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad', 'volume_size': 1} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-793370117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7561cc-92c6-4a81-9199-ba17d2bb0cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21af6bef9e7b44f19369e13763adf57c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:14:20Z,use_quota=True,user_id='f27650fc64ff4d838839f66268283409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Creating volume 3d7561cc-92c6-4a81-9199-ba17d2bb0cad {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:14:20 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:14:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:20 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad 1073741824 Apr 24 17:14:20 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:21 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad 1073741824" returned: 0 in 0.595s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:21 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad Apr 24 17:14:21 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:21 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad" returned: 0 in 0.454s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:14:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af44627b-6f9e-425e-84d1-46e710ad2bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430fa627-d919-480c-a37e-1ac62807a04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:21 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Volume volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad (3d7561cc-92c6-4a81-9199-ba17d2bb0cad): created successfully Apr 24 17:14:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430fa627-d919-480c-a37e-1ac62807a04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Flow 'volume_create_manager' (8143f721-2383-43ce-ab24-b77a6e95e668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:14:21 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0cf089b4-3705-46f4-a294-7888be51eaa3 tempest-VolumesCloneTest-934802410 None] Created volume successfully. Apr 24 17:14:22 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Flow 'volume_create_manager' (99090925-6b4c-4ef1-99b2-8870fe4b17a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b83288-94e6-4a65-9794-724eaa3836a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b83288-94e6-4a65-9794-724eaa3836a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1636393098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d6a090-3d9f-4af0-8126-97efc4dd7bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21af6bef9e7b44f19369e13763adf57c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:14:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3d7561cc-92c6-4a81-9199-ba17d2bb0cad,status='creating',terminated_at=None,updated_at=2026-04-24T15:14:23Z,use_quota=True,user_id='f27650fc64ff4d838839f66268283409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91bfa4c-f47c-4e72-89a6-af8d5f6cd5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91bfa4c-f47c-4e72-89a6-af8d5f6cd5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16d0c9b-0ebd-4320-a6ca-d96e3f555489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16d0c9b-0ebd-4320-a6ca-d96e3f555489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e9d6a090-3d9f-4af0-8126-97efc4dd7bf7', 'volume_name': 'volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7', 'volume_size': 2, 'source_volid': '3d7561cc-92c6-4a81-9199-ba17d2bb0cad', 'source_volstatus': 'available'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977ff8c0-504e-49bd-8a11-5da4adda79ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977ff8c0-504e-49bd-8a11-5da4adda79ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6e2406-5a86-46cc-a901-648ae6e26b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:23 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Volume e9d6a090-3d9f-4af0-8126-97efc4dd7bf7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7', 'volume_size': 2, 'source_volid': '3d7561cc-92c6-4a81-9199-ba17d2bb0cad', 'source_volstatus': 'available'} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:23 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Cloning volume 3d7561cc-92c6-4a81-9199-ba17d2bb0cad to volume e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Creating offline snapshot e8a82739-ef87-459e-9e42-55faa4eba226 of volume 3d7561cc-92c6-4a81-9199-ba17d2bb0cad {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[6065bb8b-f1e9-4b4e-8fcf-751b00a65a81]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:23 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad Apr 24 17:14:23 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:23 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad" returned: 0 in 0.498s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:23 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 1G Apr 24 17:14:23 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:24 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 1G" returned: 0 in 0.607s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:24 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 Apr 24 17:14:24 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:24 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226" returned: 0 in 0.457s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:24 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 is being set with open permissions: ugo+rw Apr 24 17:14:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:24 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 Apr 24 17:14:24 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:25 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226" returned: 0 in 0.419s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:25 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.info Apr 24 17:14:25 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:25 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.info" returned: 0 in 0.422s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:25 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.info is being set with open permissions: ugo+rw Apr 24 17:14:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:25 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.info Apr 24 17:14:25 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:26 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.info" returned: 0 in 0.425s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Acquiring lock "cinder-quobyte-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Lock "cinder-quobyte-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] snapshot: e8a82739-ef87-459e-9e42-55faa4eba226, volume: e9d6a090-3d9f-4af0-8126-97efc4dd7bf7, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bb7bf3-e3a9-4537-9678-16e7369602ae]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:26 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 Apr 24 17:14:26 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:26 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226" returned: 0 in 0.496s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e43e57-54a2-4d19-a2fb-630ef330e458]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:26 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad Apr 24 17:14:26 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:27 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad" returned: 0 in 0.510s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:27 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:14:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:27 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 Apr 24 17:14:27 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:31 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7" returned: 0 in 4.623s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:31 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[8175324e-dca6-42ec-81cc-2b096924e0c5]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:31 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad Apr 24 17:14:31 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:32 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad" returned: 0 in 0.640s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:32 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad, size 1024.00 MB, duration 4.62 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:14:32 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Converted 1024.00 MB image at 221.43 MB/s Apr 24 17:14:32 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 is being set with open permissions: ugo+rw Apr 24 17:14:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:32 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 Apr 24 17:14:32 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:32 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7" returned: 0 in 0.433s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Lock "cinder-quobyte-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7" released by "_copy_volume_from_snapshot" :: held 6.777s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:14:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Acquiring lock "cinder-quobyte-e8a82739-ef87-459e-9e42-55faa4eba226" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:14:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Lock "cinder-quobyte-e8a82739-ef87-459e-9e42-55faa4eba226" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:14:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Deleting offline snapshot e8a82739-ef87-459e-9e42-55faa4eba226 of volume 3d7561cc-92c6-4a81-9199-ba17d2bb0cad {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:14:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] snapshot_file for this snap is: volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:14:32 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbb009d-910a-4afb-875f-ec187fe58b01]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:32 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 Apr 24 17:14:32 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:33 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226" returned: 0 in 0.500s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:14:33 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc780c5-ad68-47d3-a57f-054477b49253]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:33 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad Apr 24 17:14:33 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:33 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad" returned: 0 in 0.499s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:33 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 Apr 24 17:14:33 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:34 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226" returned: 0 in 0.511s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:34 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226 Apr 24 17:14:34 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:34 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad.e8a82739-ef87-459e-9e42-55faa4eba226" returned: 0 in 0.423s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Lock "cinder-quobyte-e8a82739-ef87-459e-9e42-55faa4eba226" released by "_delete_snapshot" :: held 2.019s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:14:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.799s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6e2406-5a86-46cc-a901-648ae6e26b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7', 'volume_size': 2, 'source_volid': '3d7561cc-92c6-4a81-9199-ba17d2bb0cad', 'source_volstatus': 'available'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3732718-0fef-4c46-87fa-70edb42ac1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:34 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Volume volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 (e9d6a090-3d9f-4af0-8126-97efc4dd7bf7): created successfully Apr 24 17:14:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3732718-0fef-4c46-87fa-70edb42ac1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Flow 'volume_create_manager' (99090925-6b4c-4ef1-99b2-8870fe4b17a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:14:34 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e4ca582c-e193-4022-98fa-10d6d02abd36 tempest-VolumesCloneTest-934802410 None] Created volume successfully. Apr 24 17:14:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Acquiring lock "cinder-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:14:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Lock "cinder-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:14:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Acquiring lock "cinder-quobyte-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:14:36 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Lock "cinder-quobyte-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:14:36 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c699d0c-5ab1-48a5-8d30-a40ef406f140]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:36 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 Apr 24 17:14:36 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:36 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7" returned: 0 in 0.512s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:36 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7 Apr 24 17:14:36 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:37 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7" returned: 0 in 0.429s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Lock "cinder-quobyte-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7" released by "delete_volume" :: held 0.981s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Created reservations ['ed9e23a8-f7a0-404e-8c7f-af9014d8736c', '1be4bfa7-3efc-480f-9195-4efe3765b751', 'f4c78b4e-1e0a-40e5-a156-0cf3f0da17ab', '6cf3a263-af1e-470e-ba7f-a1a1cab191a8'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:37 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:14:37 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:37 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.441s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:14:37 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Deleted volume successfully. Apr 24 17:14:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6f2f27a-6bda-4f83-a23f-f8b4bde83774 tempest-VolumesCloneTest-934802410 None] Lock "cinder-e9d6a090-3d9f-4af0-8126-97efc4dd7bf7-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:14:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Acquiring lock "cinder-3d7561cc-92c6-4a81-9199-ba17d2bb0cad-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:14:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Lock "cinder-3d7561cc-92c6-4a81-9199-ba17d2bb0cad-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:14:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Acquiring lock "cinder-quobyte-3d7561cc-92c6-4a81-9199-ba17d2bb0cad" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:14:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Lock "cinder-quobyte-3d7561cc-92c6-4a81-9199-ba17d2bb0cad" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:14:38 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b3914b-5f2c-45ef-a710-37196d8deb5f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:38 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad Apr 24 17:14:38 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:38 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad" returned: 0 in 0.490s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:38 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad Apr 24 17:14:38 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:39 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3d7561cc-92c6-4a81-9199-ba17d2bb0cad" returned: 0 in 0.426s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Lock "cinder-quobyte-3d7561cc-92c6-4a81-9199-ba17d2bb0cad" released by "delete_volume" :: held 0.970s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Created reservations ['e06fea16-5b28-41cb-8066-b7d095e0e442', 'dc29c378-e8d8-43ae-a8a4-69e9bc04f9aa', '19b3d544-9f50-4b20-a79d-20c8be1112e6', '7de7d778-59f2-426d-840f-ba62dc7ef15e'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:39 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:14:39 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:39 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.452s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:14:39 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Deleted volume successfully. Apr 24 17:14:39 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-783b2856-178f-4863-b7c8-6a514e40bf4c tempest-VolumesCloneTest-934802410 None] Lock "cinder-3d7561cc-92c6-4a81-9199-ba17d2bb0cad-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Flow 'volume_create_manager' (e711101e-c275-40c3-ab8c-f0668fa4680f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf496a4-ed3a-4c9e-be3d-9d7e8c2c34f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf496a4-ed3a-4c9e-be3d-9d7e8c2c34f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1207751863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba8a77e-2535-427c-a84d-f0c1640999c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d1448064d64bbdb59eaf2ba6157e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:14:43Z,use_quota=True,user_id='15425679aa0b4a4f946095637c1c463c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902d07cc-f968-46f9-b330-18887490dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902d07cc-f968-46f9-b330-18887490dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c778a05-af06-4e53-bf78-9a110abdd349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.image.glance [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Creating Keystone auth plugin from conf {{(pid=81986) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c778a05-af06-4e53-bf78-9a110abdd349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3ba8a77e-2535-427c-a84d-f0c1640999c2', 'volume_name': 'volume-3ba8a77e-2535-427c-a84d-f0c1640999c2', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02caf0e1-699a-450f-afad-66109eac185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02caf0e1-699a-450f-afad-66109eac185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb2a3d6-45bb-45fe-8c6a-f63cd33414b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:43 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Volume 3ba8a77e-2535-427c-a84d-f0c1640999c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3ba8a77e-2535-427c-a84d-f0c1640999c2', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Trying to clone 3ba8a77e-2535-427c-a84d-f0c1640999c2 from image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]). {{(pid=81986) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 17:14:43 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Image download 20.69 MB at 20.69 MB/s Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[825fae61-62b6-461e-951f-ec41a2aff598]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:43 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD Apr 24 17:14:43 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:44 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Temporary image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 is fetched for user 15425679aa0b4a4f946095637c1c463c. {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafbe188-112b-4faf-b148-59068b068d85]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:44 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD Apr 24 17:14:44 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:44 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1207751863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba8a77e-2535-427c-a84d-f0c1640999c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d1448064d64bbdb59eaf2ba6157e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:14:43Z,use_quota=True,user_id='15425679aa0b4a4f946095637c1c463c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Creating volume 3ba8a77e-2535-427c-a84d-f0c1640999c2 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:14:44 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:14:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:44 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 1073741824 Apr 24 17:14:44 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:45 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 1073741824" returned: 0 in 0.587s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:45 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 Apr 24 17:14:45 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:45 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2" returned: 0 in 0.418s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:14:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:45 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Attempting download of 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}])) to volume 3ba8a77e-2535-427c-a84d-f0c1640999c2. {{(pid=81986) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 17:14:45 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0256ba-481a-4c7d-a5f9-b2863417d113]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_lprfq4s_ {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:45 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_lprfq4s_ Apr 24 17:14:45 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:46 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_lprfq4s_" returned: 0 in 0.469s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_lprfq4s_ {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:46 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_lprfq4s_ Apr 24 17:14:46 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:46 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_lprfq4s_" returned: 1 in 0.470s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_lprfq4s_' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:14:46 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9a1035-54f8-4ae2-97db-21af4548941c]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:46 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD Apr 24 17:14:46 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:47 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:47 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 was qcow2, converting to raw {{(pid=81986) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 17:14:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:47 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 Apr 24 17:14:47 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:48 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2" returned: 0 in 1.251s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:48 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_82692ac4-ca4c-4fa4-b64c-58e77169bcf7_vsxohg4zdevstack@QuobyteHD, size 112.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:14:48 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Converted 112.00 MB image at 89.40 MB/s Apr 24 17:14:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:48 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 1G Apr 24 17:14:48 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:48 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 1G" returned: 0 in 0.449s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:48 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[65437211-1ae7-4d84-8b6d-2d8711ec607b]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:48 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 Apr 24 17:14:48 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:49 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2" returned: 0 in 0.500s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:49 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 Apr 24 17:14:49 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:49 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2" returned: 1 in 0.483s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:14:49 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Downloaded image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}])) to volume 3ba8a77e-2535-427c-a84d-f0c1640999c2 successfully. {{(pid=81986) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 17:14:49 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Temporary image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 for user 15425679aa0b4a4f946095637c1c463c is deleted. {{(pid=81986) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 17:14:49 devstack cinder-volume[81986]: DEBUG cinder.volume.volume_utils [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Marking volume 3ba8a77e-2535-427c-a84d-f0c1640999c2 as bootable. {{(pid=81986) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 17:14:49 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Copying metadata from image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 to 3ba8a77e-2535-427c-a84d-f0c1640999c2. {{(pid=81986) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 17:14:49 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Creating volume glance metadata for volume 3ba8a77e-2535-427c-a84d-f0c1640999c2 backed by image 82692ac4-ca4c-4fa4-b64c-58e77169bcf7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81986) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 17:14:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb2a3d6-45bb-45fe-8c6a-f63cd33414b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba8a77e-2535-427c-a84d-f0c1640999c2', 'volume_size': 1, 'image_id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f11b2651f184acdbe76da08035e2b12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '82692ac4-ca4c-4fa4-b64c-58e77169bcf7', 'created_at': datetime.datetime(2026, 4, 24, 14, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 14, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82692ac4-ca4c-4fa4-b64c-58e77169bcf7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ce0c14-5aca-45b1-8e6c-a85a44f59b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:50 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Volume volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 (3ba8a77e-2535-427c-a84d-f0c1640999c2): created successfully Apr 24 17:14:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ce0c14-5aca-45b1-8e6c-a85a44f59b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Flow 'volume_create_manager' (e711101e-c275-40c3-ab8c-f0668fa4680f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:14:50 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0bdd3226-c9dc-4160-9530-5ad4166fe1ef tempest-VolumesExtendTest-1479117396 None] Created volume successfully. Apr 24 17:14:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-15c43304-d3bb-430e-bd66-e9c2ccf87405 tempest-VolumesExtendTest-1479117396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-15c43304-d3bb-430e-bd66-e9c2ccf87405 tempest-VolumesExtendTest-1479117396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:50 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb603461-d035-4693-aa93-99b1ffe0f871]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15c43304-d3bb-430e-bd66-e9c2ccf87405 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:50 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 Apr 24 17:14:50 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:51 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15c43304-d3bb-430e-bd66-e9c2ccf87405 tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2" returned: 0 in 0.497s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15c43304-d3bb-430e-bd66-e9c2ccf87405 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:51 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 Apr 24 17:14:51 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:51 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15c43304-d3bb-430e-bd66-e9c2ccf87405 tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2" returned: 1 in 0.497s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15c43304-d3bb-430e-bd66-e9c2ccf87405 tempest-VolumesExtendTest-1479117396 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:14:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15c43304-d3bb-430e-bd66-e9c2ccf87405 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 2G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15c43304-d3bb-430e-bd66-e9c2ccf87405 tempest-VolumesExtendTest-1479117396 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 2G" returned: 0 in 0.063s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-15c43304-d3bb-430e-bd66-e9c2ccf87405 tempest-VolumesExtendTest-1479117396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.097s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:51 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-15c43304-d3bb-430e-bd66-e9c2ccf87405 tempest-VolumesExtendTest-1479117396 None] Extend volume completed successfully. Apr 24 17:14:52 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Acquiring lock "cinder-3ba8a77e-2535-427c-a84d-f0c1640999c2-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:14:52 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Lock "cinder-3ba8a77e-2535-427c-a84d-f0c1640999c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:14:52 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Acquiring lock "cinder-quobyte-3ba8a77e-2535-427c-a84d-f0c1640999c2" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:14:52 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Lock "cinder-quobyte-3ba8a77e-2535-427c-a84d-f0c1640999c2" acquired by "delete_volume" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:14:52 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[17eb7fac-f5a9-4964-90d8-6f2ff1fdfe89]: (4, 'raw') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:53 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 Apr 24 17:14:53 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:53 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2" returned: 0 in 0.526s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:53 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 Apr 24 17:14:53 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:54 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2" returned: 1 in 0.516s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2' failed. Not Retrying. {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:54 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2 Apr 24 17:14:54 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:54 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3ba8a77e-2535-427c-a84d-f0c1640999c2" returned: 0 in 0.419s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Lock "cinder-quobyte-3ba8a77e-2535-427c-a84d-f0c1640999c2" released by "delete_volume" :: held 1.524s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Created reservations ['f7ab2fc9-502c-4f7d-bd20-7cc853d88de6', '80be3da2-fadd-4bbd-bdb8-9d87f8561059', 'a752bf34-4b58-428d-8a29-8c4212940e53', '47ba8102-c5ef-444a-a160-e29ad2d43e97'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:54 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:14:54 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:55 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.439s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:14:55 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Deleted volume successfully. Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-402193fd-6f57-498c-9c77-bb86229f0e4f tempest-VolumesExtendTest-1479117396 None] Lock "cinder-3ba8a77e-2535-427c-a84d-f0c1640999c2-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Flow 'volume_create_manager' (179a9dbc-6319-41ee-a45e-0c663cb88ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcdb663-fea0-4e3f-b41e-edfad57aa045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcdb663-fea0-4e3f-b41e-edfad57aa045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-603129746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f59751c-9213-49b6-a4bd-a9b0c2f7af52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d1448064d64bbdb59eaf2ba6157e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:14:55Z,use_quota=True,user_id='15425679aa0b4a4f946095637c1c463c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4c6a1f-b541-44aa-9df5-8ce625c7778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4c6a1f-b541-44aa-9df5-8ce625c7778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3e714e-a819-4ffb-9826-bec42b64a071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3e714e-a819-4ffb-9826-bec42b64a071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f59751c-9213-49b6-a4bd-a9b0c2f7af52', 'volume_name': 'volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98deb595-480f-4e71-8287-e40e2c887b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98deb595-480f-4e71-8287-e40e2c887b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4eacc6-85f2-4977-b0c0-79779a0e748a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:55 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Volume 4f59751c-9213-49b6-a4bd-a9b0c2f7af52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52', 'volume_size': 1} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-603129746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f59751c-9213-49b6-a4bd-a9b0c2f7af52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d1448064d64bbdb59eaf2ba6157e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:14:55Z,use_quota=True,user_id='15425679aa0b4a4f946095637c1c463c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Creating volume 4f59751c-9213-49b6-a4bd-a9b0c2f7af52 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:14:55 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:14:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:55 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 1073741824 Apr 24 17:14:55 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:56 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 1073741824" returned: 0 in 0.611s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:56 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 Apr 24 17:14:56 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:56 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" returned: 0 in 0.452s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:14:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:14:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4eacc6-85f2-4977-b0c0-79779a0e748a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91912bb7-0428-41ba-8321-08848b8c34c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:14:56 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Volume volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 (4f59751c-9213-49b6-a4bd-a9b0c2f7af52): created successfully Apr 24 17:14:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91912bb7-0428-41ba-8321-08848b8c34c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:14:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Flow 'volume_create_manager' (179a9dbc-6319-41ee-a45e-0c663cb88ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:14:56 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-910a514c-45c8-4772-9c57-87ffc86a521a tempest-VolumesExtendTest-1479117396 None] Created volume successfully. Apr 24 17:14:57 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=38,cinder:UPDATE=52,cinder:INSERT=15,cinder:DELETE=3 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:14:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:14:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:14:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] Creating offline snapshot eab99311-926c-4f2d-b53e-45a04e97becb of volume 4f59751c-9213-49b6-a4bd-a9b0c2f7af52 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:14:57 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[908079bf-7e59-492e-ad69-d26393e089dc]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:14:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:57 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 Apr 24 17:14:57 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:58 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" returned: 0 in 0.518s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:58 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb 1G Apr 24 17:14:58 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:58 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb 1G" returned: 0 in 0.593s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:58 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb Apr 24 17:14:58 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:59 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb" returned: 0 in 0.469s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:59 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb is being set with open permissions: ugo+rw Apr 24 17:14:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:59 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb Apr 24 17:14:59 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:14:59 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 24 17:14:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb" returned: 0 in 0.428s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:14:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:14:59 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.info Apr 24 17:14:59 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:00 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.info" returned: 0 in 0.447s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:00 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.info is being set with open permissions: ugo+rw Apr 24 17:15:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:00 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.info Apr 24 17:15:00 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:00 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.info" returned: 0 in 0.426s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.967s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:00 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f29e6ee1-10f2-4643-8c6b-bae4017e328d tempest-VolumesExtendTest-1479117396 None] Create snapshot completed successfully Apr 24 17:15:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-38bf3146-f762-4272-9f0e-aaf1c9733e90 tempest-VolumesExtendTest-1479117396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-38bf3146-f762-4272-9f0e-aaf1c9733e90 tempest-VolumesExtendTest-1479117396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:00 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[16db511c-d4e8-46cc-9b25-e45359a6ee45]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-38bf3146-f762-4272-9f0e-aaf1c9733e90 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:01 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 Apr 24 17:15:01 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:01 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-38bf3146-f762-4272-9f0e-aaf1c9733e90 tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" returned: 0 in 0.520s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-38bf3146-f762-4272-9f0e-aaf1c9733e90 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb 2G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-38bf3146-f762-4272-9f0e-aaf1c9733e90 tempest-VolumesExtendTest-1479117396 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb 2G" returned: 0 in 0.122s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-38bf3146-f762-4272-9f0e-aaf1c9733e90 tempest-VolumesExtendTest-1479117396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.672s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:01 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-38bf3146-f762-4272-9f0e-aaf1c9733e90 tempest-VolumesExtendTest-1479117396 None] Extend volume completed successfully. Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Acquiring lock "cinder-eab99311-926c-4f2d-b53e-45a04e97becb-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Lock "cinder-eab99311-926c-4f2d-b53e-45a04e97becb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Acquiring lock "cinder-quobyte-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Lock "cinder-quobyte-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Acquiring lock "cinder-quobyte-eab99311-926c-4f2d-b53e-45a04e97becb" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Lock "cinder-quobyte-eab99311-926c-4f2d-b53e-45a04e97becb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Deleting offline snapshot eab99311-926c-4f2d-b53e-45a04e97becb of volume 4f59751c-9213-49b6-a4bd-a9b0c2f7af52 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] snapshot_file for this snap is: volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf774208-916d-41c3-b69c-2d27571fe5a4]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:02 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb Apr 24 17:15:02 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:02 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb" returned: 0 in 0.511s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0adfae2-60bd-47f9-a59d-e21f50db67d8]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:02 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 Apr 24 17:15:02 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:02 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:15:02 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:03 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" returned: 0 in 0.532s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:03 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.431s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:15:03 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb Apr 24 17:15:03 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:03 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb" returned: 0 in 0.558s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:03 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb Apr 24 17:15:03 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:04 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52.eab99311-926c-4f2d-b53e-45a04e97becb" returned: 0 in 0.441s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Lock "cinder-quobyte-eab99311-926c-4f2d-b53e-45a04e97becb" released by "_delete_snapshot" :: held 2.140s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Lock "cinder-quobyte-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" released by "delete_snapshot" :: held 2.165s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:04 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Created reservations ['2b60d7ff-5951-467d-a282-ab210e383f0e', '6e58c127-a543-4523-8b9e-26111cc97e61', 'fa10e917-244e-4b72-a986-32e355c38e23', '96f51639-2b95-4ad6-ac0c-2e9a3a82120a'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:15:04 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Delete snapshot completed successfully. Apr 24 17:15:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-389c00e6-18dc-4485-807c-8460215426d7 tempest-VolumesExtendTest-1479117396 None] Lock "cinder-eab99311-926c-4f2d-b53e-45a04e97becb-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Acquiring lock "cinder-4f59751c-9213-49b6-a4bd-a9b0c2f7af52-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Lock "cinder-4f59751c-9213-49b6-a4bd-a9b0c2f7af52-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Acquiring lock "cinder-quobyte-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Lock "cinder-quobyte-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:05 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22a88d0-0b33-40f2-b6a6-ff49fe1d1e86]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:05 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 Apr 24 17:15:05 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:06 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" returned: 0 in 0.552s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:06 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52 Apr 24 17:15:06 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:06 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" returned: 0 in 0.432s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Lock "cinder-quobyte-4f59751c-9213-49b6-a4bd-a9b0c2f7af52" released by "delete_volume" :: held 1.042s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:06 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Created reservations ['4a0d0f7b-970a-411b-8ae1-5ffec79e596e', 'bae07d12-5138-4148-9801-76663736302b', '9115e069-54f3-4fcd-bbeb-1ef81f44f095', '028558e6-e3a8-40f6-9426-75a94ce79609'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:15:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:06 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:15:06 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:07 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.420s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:07 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:15:07 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Deleted volume successfully. Apr 24 17:15:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-5f283160-0d58-4368-ae69-56f55a60f9b3 tempest-VolumesExtendTest-1479117396 None] Lock "cinder-4f59751c-9213-49b6-a4bd-a9b0c2f7af52-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:09 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=67,cinder:UPDATE=66,cinder:INSERT=24,cinder:DELETE=5 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:15:09 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:15:09 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Flow 'volume_create_manager' (f7d1da9f-feac-4d03-909b-fd7e7d0c724a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:09 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a069fc-8cde-42bd-86ea-2fd7751e2ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:09 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a069fc-8cde-42bd-86ea-2fd7751e2ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1990992265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f83d1b-cf75-46bf-822f-bc8212a38cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b494a2127f141c6860496d40a8981b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:15:10Z,use_quota=True,user_id='b5426d5aef3d4a7094fdbe0cd609dd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:09 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b651bc-7043-4fea-b794-f4c0102229b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:09 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b651bc-7043-4fea-b794-f4c0102229b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:09 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07e16ec-8e2e-4562-815d-2a8e96dddd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07e16ec-8e2e-4562-815d-2a8e96dddd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f83d1b-cf75-46bf-822f-bc8212a38cd8', 'volume_name': 'volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd33ab9b-ad56-4ebf-8ffc-323ac78bc2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd33ab9b-ad56-4ebf-8ffc-323ac78bc2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e612e914-3973-4c41-8b30-3c4e47fde183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:10 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Volume d8f83d1b-cf75-46bf-822f-bc8212a38cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8', 'volume_size': 1} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1990992265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f83d1b-cf75-46bf-822f-bc8212a38cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b494a2127f141c6860496d40a8981b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:15:10Z,use_quota=True,user_id='b5426d5aef3d4a7094fdbe0cd609dd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Creating volume d8f83d1b-cf75-46bf-822f-bc8212a38cd8 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:15:10 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:10 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 1073741824 Apr 24 17:15:10 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:10 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 1073741824" returned: 0 in 0.630s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:10 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 Apr 24 17:15:10 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:11 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" returned: 0 in 0.427s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:15:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e612e914-3973-4c41-8b30-3c4e47fde183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfd19ab-9f1a-4c5c-9a0e-814e7e1cb306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:11 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Volume volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 (d8f83d1b-cf75-46bf-822f-bc8212a38cd8): created successfully Apr 24 17:15:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfd19ab-9f1a-4c5c-9a0e-814e7e1cb306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:11 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Flow 'volume_create_manager' (f7d1da9f-feac-4d03-909b-fd7e7d0c724a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:11 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ef670087-a0ac-4f8b-af40-2db17d0b1336 tempest-VolumeDependencyTests-1587758192 None] Created volume successfully. Apr 24 17:15:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:12 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] Creating offline snapshot 79bc67cd-cd99-4ea0-b905-8e79e1bb99eb of volume d8f83d1b-cf75-46bf-822f-bc8212a38cd8 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:15:12 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c02fdb-1665-4bcb-a9e2-27bc8264e075]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:12 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 Apr 24 17:15:12 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:12 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" returned: 0 in 0.499s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:12 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb 1G Apr 24 17:15:12 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:13 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb 1G" returned: 0 in 0.597s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:13 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb Apr 24 17:15:13 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:13 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb" returned: 0 in 0.510s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:13 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb is being set with open permissions: ugo+rw Apr 24 17:15:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:13 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb Apr 24 17:15:13 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:14 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb" returned: 0 in 0.435s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:14 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.info Apr 24 17:15:14 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:14 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.info" returned: 0 in 0.436s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:14 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.info is being set with open permissions: ugo+rw Apr 24 17:15:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:14 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.info Apr 24 17:15:14 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:15 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.info" returned: 0 in 0.429s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.985s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:15 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-205b8dae-9f70-425e-8c5f-0b26c9eb603e tempest-VolumeDependencyTests-1587758192 None] Create snapshot completed successfully Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Flow 'volume_create_manager' (1150fea9-6733-41f3-a939-7e66a89f51f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59c6cc9-a9ff-47f1-bf60-87433788919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59c6cc9-a9ff-47f1-bf60-87433788919d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-3310741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1945eb2d-f224-4588-b80f-f1457c8da969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b494a2127f141c6860496d40a8981b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79bc67cd-cd99-4ea0-b905-8e79e1bb99eb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:15:16Z,use_quota=True,user_id='b5426d5aef3d4a7094fdbe0cd609dd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f506d2db-5f8e-4ddc-8f36-a8f0c59279ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f506d2db-5f8e-4ddc-8f36-a8f0c59279ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3867e220-2726-41b7-a09e-b41ee4cda825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3867e220-2726-41b7-a09e-b41ee4cda825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1945eb2d-f224-4588-b80f-f1457c8da969', 'volume_name': 'volume-1945eb2d-f224-4588-b80f-f1457c8da969', 'volume_size': 1, 'snapshot_id': '79bc67cd-cd99-4ea0-b905-8e79e1bb99eb'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b1e900-2c3a-4390-93c7-626040c0285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b1e900-2c3a-4390-93c7-626040c0285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fecfe19-411d-47e9-bdb3-57dd1fc76abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:15 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Volume 1945eb2d-f224-4588-b80f-f1457c8da969: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1945eb2d-f224-4588-b80f-f1457c8da969', 'volume_size': 1, 'snapshot_id': '79bc67cd-cd99-4ea0-b905-8e79e1bb99eb'} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-quobyte-79bc67cd-cd99-4ea0-b905-8e79e1bb99eb-1945eb2d-f224-4588-b80f-f1457c8da969" by "_create_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-79bc67cd-cd99-4ea0-b905-8e79e1bb99eb-1945eb2d-f224-4588-b80f-f1457c8da969" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Creating volume 1945eb2d-f224-4588-b80f-f1457c8da969 from snapshot 79bc67cd-cd99-4ea0-b905-8e79e1bb99eb {{(pid=81986) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-quobyte-1945eb2d-f224-4588-b80f-f1457c8da969" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-1945eb2d-f224-4588-b80f-f1457c8da969" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] snapshot: 79bc67cd-cd99-4ea0-b905-8e79e1bb99eb, volume: 1945eb2d-f224-4588-b80f-f1457c8da969, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f96d873-6244-4285-9c2e-561ee3768ba2]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:15 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb Apr 24 17:15:15 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:16 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb" returned: 0 in 0.522s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:15:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:15:16 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:15:16 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef7c490-8522-4f88-99f5-e855274e8b06]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:16 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 Apr 24 17:15:16 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:16 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" returned: 0 in 0.532s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:16 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969 not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:15:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:16 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969 Apr 24 17:15:16 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:21 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969" returned: 0 in 4.304s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:21 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5889c0-ed56-43a7-b4f8-52ae08462a1c]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:21 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 Apr 24 17:15:21 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:21 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" returned: 0 in 0.606s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:21 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8, size 1024.00 MB, duration 4.31 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:15:21 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Converted 1024.00 MB image at 237.80 MB/s Apr 24 17:15:21 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969 is being set with open permissions: ugo+rw Apr 24 17:15:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:21 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969 Apr 24 17:15:21 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:22 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969" returned: 0 in 0.432s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-1945eb2d-f224-4588-b80f-f1457c8da969" released by "_copy_volume_from_snapshot" :: held 6.492s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-79bc67cd-cd99-4ea0-b905-8e79e1bb99eb-1945eb2d-f224-4588-b80f-f1457c8da969" released by "_create_volume_from_snapshot" :: held 6.523s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.543s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fecfe19-411d-47e9-bdb3-57dd1fc76abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1945eb2d-f224-4588-b80f-f1457c8da969', 'volume_size': 1, 'snapshot_id': '79bc67cd-cd99-4ea0-b905-8e79e1bb99eb'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c004629a-ef87-41fe-af2d-8c22980ad1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:22 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Volume volume-1945eb2d-f224-4588-b80f-f1457c8da969 (1945eb2d-f224-4588-b80f-f1457c8da969): created successfully Apr 24 17:15:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c004629a-ef87-41fe-af2d-8c22980ad1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Flow 'volume_create_manager' (1150fea9-6733-41f3-a939-7e66a89f51f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:22 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-6d42fa2d-bf42-4e16-9a64-c33e06fb5c88 tempest-VolumeDependencyTests-1587758192 None] Created volume successfully. Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-79bc67cd-cd99-4ea0-b905-8e79e1bb99eb-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-79bc67cd-cd99-4ea0-b905-8e79e1bb99eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-quobyte-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-quobyte-79bc67cd-cd99-4ea0-b905-8e79e1bb99eb" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-79bc67cd-cd99-4ea0-b905-8e79e1bb99eb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Deleting offline snapshot 79bc67cd-cd99-4ea0-b905-8e79e1bb99eb of volume d8f83d1b-cf75-46bf-822f-bc8212a38cd8 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] snapshot_file for this snap is: volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecb3cda-7690-4ff0-8269-0ec04fd7266d]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:23 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb Apr 24 17:15:23 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:23 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb" returned: 0 in 0.514s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b48601-9019-4c4d-8a36-bdc4e832c9c9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:24 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 Apr 24 17:15:24 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:24 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" returned: 0 in 0.532s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:24 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb Apr 24 17:15:24 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:25 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb" returned: 0 in 0.529s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:25 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb Apr 24 17:15:25 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:25 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8.79bc67cd-cd99-4ea0-b905-8e79e1bb99eb" returned: 0 in 0.468s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-79bc67cd-cd99-4ea0-b905-8e79e1bb99eb" released by "_delete_snapshot" :: held 2.144s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" released by "delete_snapshot" :: held 2.170s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:25 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Created reservations ['aba614ae-5be6-4aec-a015-95591c2b9409', '3a700cbf-9129-4972-9fc1-517b14c2e972', '9e76ce0b-65fb-4012-8d1f-4ce72b2837e0', '6820dd1f-62bc-473e-93d5-4fb74d3a82e2'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:15:25 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Delete snapshot completed successfully. Apr 24 17:15:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-6569c88d-4b10-4f38-9344-f2e89840450e tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-79bc67cd-cd99-4ea0-b905-8e79e1bb99eb-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-d8f83d1b-cf75-46bf-822f-bc8212a38cd8-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-d8f83d1b-cf75-46bf-822f-bc8212a38cd8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-quobyte-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:26 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" acquired by "delete_volume" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:26 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a4eb1c-90a1-4223-bf17-80667f897b2d]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:26 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 Apr 24 17:15:26 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:27 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" returned: 0 in 0.556s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:27 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8 Apr 24 17:15:27 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:27 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" returned: 0 in 0.483s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-d8f83d1b-cf75-46bf-822f-bc8212a38cd8" released by "delete_volume" :: held 1.095s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:27 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Created reservations ['8cade078-24b6-4e60-a6ee-fa4ece96ba9e', '3ce14c7b-3a35-4547-b3d6-d540add71e90', '628a5908-538b-4b56-8ca3-c8007a36d8b7', '897cbbb6-507e-4ce0-9fbe-557360e1edcd'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:15:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:27 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:15:27 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:28 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.452s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:28 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:15:28 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Deleted volume successfully. Apr 24 17:15:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ea24ed35-12b0-4456-96d7-488bbfca4d17 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-d8f83d1b-cf75-46bf-822f-bc8212a38cd8-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Flow 'volume_create_manager' (f5d00f87-91ea-4656-91ca-24f14a088087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687455cf-0043-45d4-b875-9cdeed9c84e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687455cf-0043-45d4-b875-9cdeed9c84e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2046163073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b97a22-15ad-4b0e-a48a-0493d0337130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b494a2127f141c6860496d40a8981b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:15:29Z,use_quota=True,user_id='b5426d5aef3d4a7094fdbe0cd609dd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220c758e-9b34-41a6-b9b7-8fbc83c09183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220c758e-9b34-41a6-b9b7-8fbc83c09183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0c464b-645a-4a4c-b670-aeb23e3e3d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0c464b-645a-4a4c-b670-aeb23e3e3d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b97a22-15ad-4b0e-a48a-0493d0337130', 'volume_name': 'volume-52b97a22-15ad-4b0e-a48a-0493d0337130', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efeabe09-8bb3-46c1-a470-60b65f61443b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efeabe09-8bb3-46c1-a470-60b65f61443b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab612b88-6968-4455-8a88-ff5fc7990071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:29 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Volume 52b97a22-15ad-4b0e-a48a-0493d0337130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b97a22-15ad-4b0e-a48a-0493d0337130', 'volume_size': 1} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2046163073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b97a22-15ad-4b0e-a48a-0493d0337130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b494a2127f141c6860496d40a8981b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:15:29Z,use_quota=True,user_id='b5426d5aef3d4a7094fdbe0cd609dd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Creating volume 52b97a22-15ad-4b0e-a48a-0493d0337130 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:15:29 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:29 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 1073741824 Apr 24 17:15:29 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:29 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 1073741824" returned: 0 in 0.588s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:29 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 Apr 24 17:15:29 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:30 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130" returned: 0 in 0.441s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:30 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:15:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab612b88-6968-4455-8a88-ff5fc7990071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b97a22-15ad-4b0e-a48a-0493d0337130', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e253f0a-98a1-4d37-8326-b31cf7d19f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:30 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Volume volume-52b97a22-15ad-4b0e-a48a-0493d0337130 (52b97a22-15ad-4b0e-a48a-0493d0337130): created successfully Apr 24 17:15:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e253f0a-98a1-4d37-8326-b31cf7d19f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:30 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Flow 'volume_create_manager' (f5d00f87-91ea-4656-91ca-24f14a088087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:30 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b798ed2e-2b3c-4baf-b90d-8e227035f4df tempest-VolumeDependencyTests-1587758192 None] Created volume successfully. Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Flow 'volume_create_manager' (2a13dec2-f213-43d9-991a-4ae03cee777a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0eec5e-8b1d-48ba-8719-08fabc488fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0eec5e-8b1d-48ba-8719-08fabc488fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1900519384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8cc525-d5e5-4fcb-a78d-6671539d405d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b494a2127f141c6860496d40a8981b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=52b97a22-15ad-4b0e-a48a-0493d0337130,status='creating',terminated_at=None,updated_at=2026-04-24T15:15:31Z,use_quota=True,user_id='b5426d5aef3d4a7094fdbe0cd609dd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bb40e6-f791-4e2d-8d5e-c1ab9846b728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bb40e6-f791-4e2d-8d5e-c1ab9846b728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35162014-492d-45ae-a9c7-a445233c4076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35162014-492d-45ae-a9c7-a445233c4076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3e8cc525-d5e5-4fcb-a78d-6671539d405d', 'volume_name': 'volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d', 'volume_size': 1, 'source_volid': '52b97a22-15ad-4b0e-a48a-0493d0337130', 'source_volstatus': 'available'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d08e235-e183-4f06-9fc8-db99197c0633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d08e235-e183-4f06-9fc8-db99197c0633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f65f971-95e4-44c2-9759-b872c81a2867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:31 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Volume 3e8cc525-d5e5-4fcb-a78d-6671539d405d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d', 'volume_size': 1, 'source_volid': '52b97a22-15ad-4b0e-a48a-0493d0337130', 'source_volstatus': 'available'} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:31 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Cloning volume 52b97a22-15ad-4b0e-a48a-0493d0337130 to volume 3e8cc525-d5e5-4fcb-a78d-6671539d405d Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Creating offline snapshot dc8e2053-f6e2-4a17-8503-2db11a88e618 of volume 52b97a22-15ad-4b0e-a48a-0493d0337130 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a1d7aa-a9db-418a-924c-abf57fff8435]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:31 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 Apr 24 17:15:31 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:32 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130" returned: 0 in 0.522s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:32 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 1G Apr 24 17:15:32 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:32 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 1G" returned: 0 in 0.608s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b97a22-15ad-4b0e-a48a-0493d0337130 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:32 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b97a22-15ad-4b0e-a48a-0493d0337130 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 Apr 24 17:15:32 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:33 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b97a22-15ad-4b0e-a48a-0493d0337130 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618" returned: 0 in 0.488s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:33 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 is being set with open permissions: ugo+rw Apr 24 17:15:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:33 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 Apr 24 17:15:33 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:33 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618" returned: 0 in 0.451s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:33 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.info Apr 24 17:15:33 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:34 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.info" returned: 0 in 0.446s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:34 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.info is being set with open permissions: ugo+rw Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:34 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.info Apr 24 17:15:34 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:34 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.info" returned: 0 in 0.458s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-quobyte-3e8cc525-d5e5-4fcb-a78d-6671539d405d" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-3e8cc525-d5e5-4fcb-a78d-6671539d405d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] snapshot: dc8e2053-f6e2-4a17-8503-2db11a88e618, volume: 3e8cc525-d5e5-4fcb-a78d-6671539d405d, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[83020d97-b04a-4de7-a505-00e6632fbf2b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:34 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 Apr 24 17:15:34 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:35 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618" returned: 0 in 0.533s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b97a22-15ad-4b0e-a48a-0493d0337130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:15:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:15:35 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:15:35 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d0f65d-6b4e-4ec1-ae67-e04cd2c1c888]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:35 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 Apr 24 17:15:35 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:35 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130" returned: 0 in 0.528s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:35 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:15:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:35 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d Apr 24 17:15:35 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:39 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d" returned: 0 in 4.184s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:40 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce81b40-1e06-43c2-a838-6efbe9b6f636]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:40 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 Apr 24 17:15:40 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:40 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130" returned: 0 in 0.639s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:40 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130, size 1024.00 MB, duration 4.19 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:15:40 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Converted 1024.00 MB image at 244.67 MB/s Apr 24 17:15:40 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d is being set with open permissions: ugo+rw Apr 24 17:15:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:40 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d Apr 24 17:15:40 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:41 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d" returned: 0 in 0.422s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-3e8cc525-d5e5-4fcb-a78d-6671539d405d" released by "_copy_volume_from_snapshot" :: held 6.387s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-quobyte-dc8e2053-f6e2-4a17-8503-2db11a88e618" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-dc8e2053-f6e2-4a17-8503-2db11a88e618" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Deleting offline snapshot dc8e2053-f6e2-4a17-8503-2db11a88e618 of volume 52b97a22-15ad-4b0e-a48a-0493d0337130 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] snapshot_file for this snap is: volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9349e4-d17a-439b-869a-e83157456d01]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:41 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 Apr 24 17:15:41 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:41 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618" returned: 0 in 0.510s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b97a22-15ad-4b0e-a48a-0493d0337130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f1f76a-381e-4219-8830-f143a8c53f12]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:41 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 Apr 24 17:15:41 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:42 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130" returned: 0 in 0.501s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:42 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 Apr 24 17:15:42 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:42 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618" returned: 0 in 0.512s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:42 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618 Apr 24 17:15:42 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:43 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130.dc8e2053-f6e2-4a17-8503-2db11a88e618" returned: 0 in 0.433s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-dc8e2053-f6e2-4a17-8503-2db11a88e618" released by "_delete_snapshot" :: held 2.043s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.581s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f65f971-95e4-44c2-9759-b872c81a2867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d', 'volume_size': 1, 'source_volid': '52b97a22-15ad-4b0e-a48a-0493d0337130', 'source_volstatus': 'available'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec9272e-a4dd-488a-9b78-3e1b613c916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:43 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Volume volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d (3e8cc525-d5e5-4fcb-a78d-6671539d405d): created successfully Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec9272e-a4dd-488a-9b78-3e1b613c916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Flow 'volume_create_manager' (2a13dec2-f213-43d9-991a-4ae03cee777a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:43 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-983ba4cf-5385-44c6-8bb1-7b2d0d0873b2 tempest-VolumeDependencyTests-1587758192 None] Created volume successfully. Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-52b97a22-15ad-4b0e-a48a-0493d0337130-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-52b97a22-15ad-4b0e-a48a-0493d0337130-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-quobyte-52b97a22-15ad-4b0e-a48a-0493d0337130" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-52b97a22-15ad-4b0e-a48a-0493d0337130" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[47196147-1f22-4737-be06-ca3dfd2e8e51]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:43 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 Apr 24 17:15:43 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:43 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130" returned: 0 in 0.492s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:43 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130 Apr 24 17:15:43 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:44 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-52b97a22-15ad-4b0e-a48a-0493d0337130" returned: 0 in 0.436s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-52b97a22-15ad-4b0e-a48a-0493d0337130" released by "delete_volume" :: held 0.983s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Created reservations ['07387652-9511-4265-8c91-fb32eaa33284', 'beb7b68f-6660-431c-b2d4-9398673f0065', '7799e4da-cd2f-4002-9f05-217b4638fa95', 'a7a05479-1f3b-4014-8d94-689ec331a8c7'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:44 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:15:44 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:44 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.428s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:15:44 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Deleted volume successfully. Apr 24 17:15:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a547d346-3e92-4d99-8b49-f04e213724e6 tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-52b97a22-15ad-4b0e-a48a-0493d0337130-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-3e8cc525-d5e5-4fcb-a78d-6671539d405d-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-3e8cc525-d5e5-4fcb-a78d-6671539d405d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-quobyte-3e8cc525-d5e5-4fcb-a78d-6671539d405d" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-3e8cc525-d5e5-4fcb-a78d-6671539d405d" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:45 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee252c4-e777-4016-a29c-f8664d74f96d]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:45 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d Apr 24 17:15:45 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:46 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d" returned: 0 in 0.504s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:46 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d Apr 24 17:15:46 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:46 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-3e8cc525-d5e5-4fcb-a78d-6671539d405d" returned: 0 in 0.411s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-3e8cc525-d5e5-4fcb-a78d-6671539d405d" released by "delete_volume" :: held 0.950s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Created reservations ['ec9f03c2-b57c-411b-8a9a-8f23e71db80e', 'b63a6a7a-1ef9-4842-b37f-7177cc69d5b1', '17cc28aa-cbe6-41e1-b9bf-a1cbff6971a6', 'ee5a7d3b-9e33-4652-8da0-d48517c67200'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:46 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:15:46 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-1945eb2d-f224-4588-b80f-f1457c8da969-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-1945eb2d-f224-4588-b80f-f1457c8da969-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "cinder-quobyte-1945eb2d-f224-4588-b80f-f1457c8da969" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-1945eb2d-f224-4588-b80f-f1457c8da969" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[290f473b-d3a9-40b6-a795-6a585fce9c11]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:46 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969 Apr 24 17:15:46 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:47 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.464s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:15:47 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Deleted volume successfully. Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-755d7186-eff6-4329-9a67-cf3cd3909e8b tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-3e8cc525-d5e5-4fcb-a78d-6671539d405d-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:47 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969" returned: 0 in 0.539s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:47 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969 Apr 24 17:15:47 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:47 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-1945eb2d-f224-4588-b80f-f1457c8da969" returned: 0 in 0.429s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-quobyte-1945eb2d-f224-4588-b80f-f1457c8da969" released by "delete_volume" :: held 1.007s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Created reservations ['87630611-3ee8-433c-bad4-649b831587bb', '4c987e08-fe53-4af4-bf14-aabfa9facecb', '9d92814a-d584-4ad9-ac12-ec407413cfac', '22f9434c-78b8-4aa2-865b-f4dc529120ca'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:48 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:15:48 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:48 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.446s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:48 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:15:48 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Deleted volume successfully. Apr 24 17:15:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-9e008479-68ad-49a2-85aa-c5ebe1220ceb tempest-VolumeDependencyTests-1587758192 None] Lock "cinder-1945eb2d-f224-4588-b80f-f1457c8da969-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Flow 'volume_create_manager' (70a6f5cb-3c4f-492c-bed6-ea61ef71eb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c50d3c-6800-4a83-8555-f04858c10937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c50d3c-6800-4a83-8555-f04858c10937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6161941-f928-4ca0-8eaa-cb11b41ef892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6693bb8df1e1454a9da5edfb1b08ff40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:15:52Z,use_quota=True,user_id='bfb52fcc02bb43c19766fa0d7460d78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17c2697-2e96-4806-b2e2-5ef96bbb310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17c2697-2e96-4806-b2e2-5ef96bbb310c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872dc793-1794-41c4-ba84-5a747218c0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872dc793-1794-41c4-ba84-5a747218c0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6161941-f928-4ca0-8eaa-cb11b41ef892', 'volume_name': 'volume-c6161941-f928-4ca0-8eaa-cb11b41ef892', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ff73fb-0b4c-43d7-aa62-ce8b3d269572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ff73fb-0b4c-43d7-aa62-ce8b3d269572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a98baca-e101-453a-bf1d-1035a403133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:51 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Volume c6161941-f928-4ca0-8eaa-cb11b41ef892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6161941-f928-4ca0-8eaa-cb11b41ef892', 'volume_size': 1} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6161941-f928-4ca0-8eaa-cb11b41ef892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6693bb8df1e1454a9da5edfb1b08ff40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:15:52Z,use_quota=True,user_id='bfb52fcc02bb43c19766fa0d7460d78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Creating volume c6161941-f928-4ca0-8eaa-cb11b41ef892 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:15:51 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:15:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:51 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892 1073741824 Apr 24 17:15:51 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:52 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892 1073741824" returned: 0 in 0.591s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:52 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892 Apr 24 17:15:52 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:52 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892" returned: 0 in 0.431s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:52 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:15:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a98baca-e101-453a-bf1d-1035a403133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6161941-f928-4ca0-8eaa-cb11b41ef892', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e630e41c-a58e-4778-a8c1-f0611cf917c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:52 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Volume volume-c6161941-f928-4ca0-8eaa-cb11b41ef892 (c6161941-f928-4ca0-8eaa-cb11b41ef892): created successfully Apr 24 17:15:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e630e41c-a58e-4778-a8c1-f0611cf917c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Flow 'volume_create_manager' (70a6f5cb-3c4f-492c-bed6-ea61ef71eb80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:52 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2c02451d-9446-47e9-a05f-84a010ff7d57 tempest-CinderUnicodeTest-532401648 None] Created volume successfully. Apr 24 17:15:53 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Flow 'volume_create_manager' (e96a68bb-85cf-4eb2-9ca9-595a3fd5bb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094a44db-9e50-40e4-bd39-c9c56edfdf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094a44db-9e50-40e4-bd39-c9c56edfdf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:15:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-386536768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599604d3-0d16-4169-90bb-381701033083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6693bb8df1e1454a9da5edfb1b08ff40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:15:54Z,use_quota=True,user_id='bfb52fcc02bb43c19766fa0d7460d78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceeb8d01-a280-4482-9537-1bfbaaa9aab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceeb8d01-a280-4482-9537-1bfbaaa9aab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663688b5-a552-4b18-bbfe-22acf5967e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663688b5-a552-4b18-bbfe-22acf5967e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '599604d3-0d16-4169-90bb-381701033083', 'volume_name': 'volume-599604d3-0d16-4169-90bb-381701033083', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f25ad6d-d485-4e4a-a13a-63445cc123ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f25ad6d-d485-4e4a-a13a-63445cc123ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771ca4c6-e0df-4921-a66d-2f90300bdde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:54 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Volume 599604d3-0d16-4169-90bb-381701033083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-599604d3-0d16-4169-90bb-381701033083', 'volume_size': 1} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:15:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-386536768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599604d3-0d16-4169-90bb-381701033083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6693bb8df1e1454a9da5edfb1b08ff40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:15:54Z,use_quota=True,user_id='bfb52fcc02bb43c19766fa0d7460d78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Creating volume 599604d3-0d16-4169-90bb-381701033083 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:15:54 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:54 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 1073741824 Apr 24 17:15:54 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:54 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 1073741824" returned: 0 in 0.571s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:54 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 Apr 24 17:15:54 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:55 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083" returned: 0 in 0.412s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:15:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771ca4c6-e0df-4921-a66d-2f90300bdde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599604d3-0d16-4169-90bb-381701033083', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e367171f-f850-4191-be77-7a129597e004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:15:55 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Volume volume-599604d3-0d16-4169-90bb-381701033083 (599604d3-0d16-4169-90bb-381701033083): created successfully Apr 24 17:15:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e367171f-f850-4191-be77-7a129597e004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:15:55 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Flow 'volume_create_manager' (e96a68bb-85cf-4eb2-9ca9-595a3fd5bb44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:15:55 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d6d66668-4dc0-4092-bfd1-d4c68ef12ac4 tempest-CinderUnicodeTest-532401648 None] Created volume successfully. Apr 24 17:15:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:15:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:15:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] Creating offline snapshot 4807e72c-2f76-4a78-8095-e552058e0b77 of volume 599604d3-0d16-4169-90bb-381701033083 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:15:56 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ac361d-350f-4362-bc9d-93876cc81b9f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:56 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 Apr 24 17:15:56 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:56 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083" returned: 0 in 0.502s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:56 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 1G Apr 24 17:15:56 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:57 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 1G" returned: 0 in 0.595s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599604d3-0d16-4169-90bb-381701033083 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:57 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599604d3-0d16-4169-90bb-381701033083 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 Apr 24 17:15:57 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:57 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599604d3-0d16-4169-90bb-381701033083 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77" returned: 0 in 0.471s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:57 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 is being set with open permissions: ugo+rw Apr 24 17:15:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:57 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 Apr 24 17:15:57 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:58 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77" returned: 0 in 0.439s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:58 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=60,cinder:INSERT=23,cinder:UPDATE=76,cinder:DELETE=5 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:15:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:58 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.info Apr 24 17:15:58 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:58 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.info" returned: 0 in 0.436s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:58 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.info is being set with open permissions: ugo+rw Apr 24 17:15:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:58 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.info Apr 24 17:15:58 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:15:59 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.info" returned: 0 in 0.432s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.967s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:15:59 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b741fef2-d548-41d3-97f9-6426c6904feb tempest-CinderUnicodeTest-532401648 None] Create snapshot completed successfully Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Acquiring lock "cinder-4807e72c-2f76-4a78-8095-e552058e0b77-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Lock "cinder-4807e72c-2f76-4a78-8095-e552058e0b77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Acquiring lock "cinder-quobyte-599604d3-0d16-4169-90bb-381701033083" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Lock "cinder-quobyte-599604d3-0d16-4169-90bb-381701033083" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Acquiring lock "cinder-quobyte-4807e72c-2f76-4a78-8095-e552058e0b77" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Lock "cinder-quobyte-4807e72c-2f76-4a78-8095-e552058e0b77" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Deleting offline snapshot 4807e72c-2f76-4a78-8095-e552058e0b77 of volume 599604d3-0d16-4169-90bb-381701033083 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] snapshot_file for this snap is: volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[482ab371-902a-45d1-ad78-f4c8588f1bb0]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:15:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:15:59 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 Apr 24 17:15:59 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:00 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77" returned: 0 in 0.506s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-599604d3-0d16-4169-90bb-381701033083(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:16:00 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea64b954-6cd4-495c-a5ea-d126497fa84d]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:00 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 Apr 24 17:16:00 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:00 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083" returned: 0 in 0.504s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:00 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 Apr 24 17:16:00 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:01 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77" returned: 0 in 0.550s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:01 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77 Apr 24 17:16:01 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:01 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083.4807e72c-2f76-4a78-8095-e552058e0b77" returned: 0 in 0.437s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Lock "cinder-quobyte-4807e72c-2f76-4a78-8095-e552058e0b77" released by "_delete_snapshot" :: held 2.101s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Lock "cinder-quobyte-599604d3-0d16-4169-90bb-381701033083" released by "delete_snapshot" :: held 2.123s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:01 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Created reservations ['e4373a4a-39d4-4d19-88ac-2e2fe3dc0a75', '6733e1f6-a5b4-4998-a90a-e435bbcbc2ef', '8bd8b1d0-970f-4ca7-8709-7de1d4b31718', '952f326c-c685-485c-b55c-eee7806270b8'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:01 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Delete snapshot completed successfully. Apr 24 17:16:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f99a3ed6-6bbe-4223-8870-e4c2b1cd4465 tempest-CinderUnicodeTest-532401648 None] Lock "cinder-4807e72c-2f76-4a78-8095-e552058e0b77-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Acquiring lock "cinder-599604d3-0d16-4169-90bb-381701033083-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Lock "cinder-599604d3-0d16-4169-90bb-381701033083-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Acquiring lock "cinder-quobyte-599604d3-0d16-4169-90bb-381701033083" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Lock "cinder-quobyte-599604d3-0d16-4169-90bb-381701033083" acquired by "delete_volume" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3998358-b826-43c0-8117-0a82363f1a0c]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:02 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 Apr 24 17:16:02 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:02 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:02 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:03 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:03 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.427s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083" returned: 0 in 0.533s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:03 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083 Apr 24 17:16:03 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:03 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-599604d3-0d16-4169-90bb-381701033083" returned: 0 in 0.415s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Lock "cinder-quobyte-599604d3-0d16-4169-90bb-381701033083" released by "delete_volume" :: held 1.004s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Created reservations ['1386b359-3075-440b-a771-6883d88eb5a6', 'f8c51e1b-10d9-45d9-9262-0a7180a663fb', 'ae766f4f-1fe5-47a7-9fa2-201aba0b7d6e', '7cea0af1-cc7a-4247-b6c0-0c9586146829'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:03 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:03 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:04 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.409s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:04 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:04 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Deleted volume successfully. Apr 24 17:16:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-af294d97-274f-4e16-87f8-98b1ea6cae1f tempest-CinderUnicodeTest-532401648 None] Lock "cinder-599604d3-0d16-4169-90bb-381701033083-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Acquiring lock "cinder-c6161941-f928-4ca0-8eaa-cb11b41ef892-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Lock "cinder-c6161941-f928-4ca0-8eaa-cb11b41ef892-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Acquiring lock "cinder-quobyte-c6161941-f928-4ca0-8eaa-cb11b41ef892" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Lock "cinder-quobyte-c6161941-f928-4ca0-8eaa-cb11b41ef892" acquired by "delete_volume" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:04 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[009f4181-9a94-4556-943e-d97a28f0a154]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:05 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892 Apr 24 17:16:05 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:05 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892" returned: 0 in 0.494s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:05 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892 Apr 24 17:16:05 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:05 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c6161941-f928-4ca0-8eaa-cb11b41ef892" returned: 0 in 0.429s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Lock "cinder-quobyte-c6161941-f928-4ca0-8eaa-cb11b41ef892" released by "delete_volume" :: held 0.961s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:05 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Created reservations ['0a75b520-49f9-4101-ac85-21a2bc8c2b03', 'c5bbc0a7-872f-4caa-a7cc-e47defb5b23d', '6409d340-9c26-4d3f-81cb-0f3f4f131cee', 'd2ff3c04-6f03-464f-ac2d-531c7d7732d4'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:06 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:06 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:06 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:06 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.428s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:06 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:06 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Deleted volume successfully. Apr 24 17:16:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-d8250bd4-d09e-4526-ba30-51f7cc77cd78 tempest-CinderUnicodeTest-532401648 None] Lock "cinder-c6161941-f928-4ca0-8eaa-cb11b41ef892-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=61,cinder:UPDATE=86,cinder:DELETE=10,cinder:INSERT=19 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Flow 'volume_create_manager' (e23452e7-d122-41d5-9a45-55979e19ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d930798d-5c7b-48df-8349-929f7602f45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d930798d-5c7b-48df-8349-929f7602f45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1835873226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4533ddf2-3883-430f-8753-97aa023c3b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0d232bd6ad4f5cb2e072db2fb0da58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:16Z,use_quota=True,user_id='67d64deebd7647fbafd3b73f9e336937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c93065d-7fc2-4ad2-a2bc-48d8264d377d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c93065d-7fc2-4ad2-a2bc-48d8264d377d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6b81a9-08a6-4385-ba2a-b25946cb07b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6b81a9-08a6-4385-ba2a-b25946cb07b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4533ddf2-3883-430f-8753-97aa023c3b19', 'volume_name': 'volume-4533ddf2-3883-430f-8753-97aa023c3b19', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee80dbb-71bb-437f-918c-7ffa9c353386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee80dbb-71bb-437f-918c-7ffa9c353386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e07d7d-53ec-4320-9454-1044065e1dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:15 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Volume 4533ddf2-3883-430f-8753-97aa023c3b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4533ddf2-3883-430f-8753-97aa023c3b19', 'volume_size': 1} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1835873226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4533ddf2-3883-430f-8753-97aa023c3b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0d232bd6ad4f5cb2e072db2fb0da58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:16Z,use_quota=True,user_id='67d64deebd7647fbafd3b73f9e336937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Creating volume 4533ddf2-3883-430f-8753-97aa023c3b19 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:15 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:15 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 1073741824 Apr 24 17:16:15 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Flow 'volume_create_manager' (de98f2a2-9f24-45b3-9776-1cfd53a1d618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed816b01-b903-40e3-a719-280968f2bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed816b01-b903-40e3-a719-280968f2bc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-226272189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c938257ec5e44db879522c101cfcf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:16Z,use_quota=True,user_id='f105af1d9e45481fbd5ac64f01b06086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d11c28-9691-4e80-93b6-0b1a4db9ea24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d11c28-9691-4e80-93b6-0b1a4db9ea24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62871608-49cc-404b-afcb-645c19dff53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62871608-49cc-404b-afcb-645c19dff53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5', 'volume_name': 'volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88127ef4-f9f0-451f-ad99-cf236de81764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88127ef4-f9f0-451f-ad99-cf236de81764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969baad8-39c3-49e8-bf27-364f1d4ac8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:15 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Volume 8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5', 'volume_size': 1} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Flow 'volume_create_manager' (b46b38cb-4150-4a21-a327-9e594a5753de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039e937c-e91b-452b-81f5-0e9552534166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039e937c-e91b-452b-81f5-0e9552534166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99312671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c938257ec5e44db879522c101cfcf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:16Z,use_quota=True,user_id='f105af1d9e45481fbd5ac64f01b06086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117312dc-e86e-4552-aee1-a09136c5af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117312dc-e86e-4552-aee1-a09136c5af15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfc4136-41d8-4f9a-8772-bcd622fea8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfc4136-41d8-4f9a-8772-bcd622fea8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f', 'volume_name': 'volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f145f3f6-f6ad-4b65-a845-d16aca8bc8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f145f3f6-f6ad-4b65-a845-d16aca8bc8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e79fc27-edf2-4ff2-9288-3583fa1efcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Volume b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f', 'volume_size': 1} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (3d87765c-4eeb-4cab-92fd-66a0143d4f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d15e17a-417b-429a-ba63-0074a66e0f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d15e17a-417b-429a-ba63-0074a66e0f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213507598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c82d23-eedc-4c9b-a024-a9326d12885a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:16Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388f5b3b-ef44-44c1-b168-d8c1598bcc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388f5b3b-ef44-44c1-b168-d8c1598bcc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3338f2-aa41-44d6-9583-30f3f3cce2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3338f2-aa41-44d6-9583-30f3f3cce2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c82d23-eedc-4c9b-a024-a9326d12885a', 'volume_name': 'volume-04c82d23-eedc-4c9b-a024-a9326d12885a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf666109-8aeb-4b48-bf49-1b5a6590c828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf666109-8aeb-4b48-bf49-1b5a6590c828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34887347-ee74-41c5-a93e-8e5a2754561d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume 04c82d23-eedc-4c9b-a024-a9326d12885a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c82d23-eedc-4c9b-a024-a9326d12885a', 'volume_size': 1} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Flow 'volume_create_manager' (ade198bc-f06b-4417-8c72-b6381a23f414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f0a91c-197a-400c-a67c-8b998e82b87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f0a91c-197a-400c-a67c-8b998e82b87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2022923892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa7125c-effa-4827-9a6d-2930e2c43039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c938257ec5e44db879522c101cfcf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:16Z,use_quota=True,user_id='f105af1d9e45481fbd5ac64f01b06086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3f189a-e2cf-4fb5-a5cc-2cf88c574a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3f189a-e2cf-4fb5-a5cc-2cf88c574a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e679dfd6-6870-4386-83b9-a10e5783b19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e679dfd6-6870-4386-83b9-a10e5783b19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa7125c-effa-4827-9a6d-2930e2c43039', 'volume_name': 'volume-eaa7125c-effa-4827-9a6d-2930e2c43039', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe12b69-b774-462e-94fd-6f7e75e368a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe12b69-b774-462e-94fd-6f7e75e368a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2d7d04-daf7-4123-a99b-2e8273ba5883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Volume eaa7125c-effa-4827-9a6d-2930e2c43039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa7125c-effa-4827-9a6d-2930e2c43039', 'volume_size': 1} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:16 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 1073741824" returned: 0 in 0.922s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Flow 'volume_create_manager' (7b267bdf-32fb-4181-a3aa-7d58b211c37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd126f56-5ffb-4144-a000-5ca830830c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd126f56-5ffb-4144-a000-5ca830830c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48723218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cee3f0-23f3-488b-8800-92fcb0e5a497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c938257ec5e44db879522c101cfcf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:17Z,use_quota=True,user_id='f105af1d9e45481fbd5ac64f01b06086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987697e8-2332-41c4-a96a-935c4e66793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987697e8-2332-41c4-a96a-935c4e66793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabd98db-f81c-4840-8fcb-85f229c1bdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabd98db-f81c-4840-8fcb-85f229c1bdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14cee3f0-23f3-488b-8800-92fcb0e5a497', 'volume_name': 'volume-14cee3f0-23f3-488b-8800-92fcb0e5a497', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd88522-a689-4b30-aa69-fd04ca0547d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd88522-a689-4b30-aa69-fd04ca0547d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ce8ff7-59d6-420e-beac-9c6464ef7f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:16 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Volume 14cee3f0-23f3-488b-8800-92fcb0e5a497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14cee3f0-23f3-488b-8800-92fcb0e5a497', 'volume_size': 1} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:16 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 Apr 24 17:16:16 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:16 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Flow 'volume_create_manager' (e7ae35f2-5e62-401a-9f0b-309f3fef312e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88e69b4-f876-473d-a14b-ae63262cf372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88e69b4-f876-473d-a14b-ae63262cf372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2052249789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2ea30d-3a2f-4291-800a-efbf8686e8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c938257ec5e44db879522c101cfcf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:17Z,use_quota=True,user_id='f105af1d9e45481fbd5ac64f01b06086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3290c4-2ba6-4734-b815-f2338deb0400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3290c4-2ba6-4734-b815-f2338deb0400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362712da-4885-475f-a1f3-3faf4d72ae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362712da-4885-475f-a1f3-3faf4d72ae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba2ea30d-3a2f-4291-800a-efbf8686e8ea', 'volume_name': 'volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fc0e0f-667e-467b-932d-122fcc852929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fc0e0f-667e-467b-932d-122fcc852929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5758316-08c8-4bd6-85d1-e3423c274d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:17 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Volume ba2ea30d-3a2f-4291-800a-efbf8686e8ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea', 'volume_size': 1} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:17 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19" returned: 0 in 0.554s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.426s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-226272189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c938257ec5e44db879522c101cfcf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:16Z,use_quota=True,user_id='f105af1d9e45481fbd5ac64f01b06086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Creating volume 8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:17 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:17 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5 1073741824 Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e07d7d-53ec-4320-9454-1044065e1dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4533ddf2-3883-430f-8753-97aa023c3b19', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:17 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4fba1b-27cc-4d1d-8f76-57a12e0c42dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:17 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Volume volume-4533ddf2-3883-430f-8753-97aa023c3b19 (4533ddf2-3883-430f-8753-97aa023c3b19): created successfully Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4fba1b-27cc-4d1d-8f76-57a12e0c42dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:17 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Flow 'volume_create_manager' (e23452e7-d122-41d5-9a45-55979e19ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:17 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-8af721d1-54ac-4c26-8c14-82aeccb69e2b tempest-VolumeDependencyTests-960558612 None] Created volume successfully. Apr 24 17:16:18 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5 1073741824" returned: 0 in 0.754s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:18 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5 Apr 24 17:16:18 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:18 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5" returned: 0 in 0.509s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.577s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99312671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c938257ec5e44db879522c101cfcf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:16Z,use_quota=True,user_id='f105af1d9e45481fbd5ac64f01b06086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Creating volume b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:18 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:18 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f 1073741824 Apr 24 17:16:18 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969baad8-39c3-49e8-bf27-364f1d4ac8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6acd3d-8b7f-4dc9-944c-09e5fcb63659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:18 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Volume volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5 (8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5): created successfully Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6acd3d-8b7f-4dc9-944c-09e5fcb63659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:18 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Flow 'volume_create_manager' (de98f2a2-9f24-45b3-9776-1cfd53a1d618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:18 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-891d58ee-3e22-49dc-9faf-36caa4b5b5b6 tempest-CreateVolumesFromImageTest-239099478 None] Created volume successfully. Apr 24 17:16:19 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f 1073741824" returned: 0 in 0.692s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:19 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f Apr 24 17:16:19 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:19 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f" returned: 0 in 0.443s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.610s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213507598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c82d23-eedc-4c9b-a024-a9326d12885a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:16Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Creating volume 04c82d23-eedc-4c9b-a024-a9326d12885a {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:19 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e79fc27-edf2-4ff2-9288-3583fa1efcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:19 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a 1073741824 Apr 24 17:16:19 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2123fbbe-d59f-4281-bcc4-ec9993015810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:19 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Volume volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f (b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f): created successfully Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2123fbbe-d59f-4281-bcc4-ec9993015810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:19 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Flow 'volume_create_manager' (b46b38cb-4150-4a21-a327-9e594a5753de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:19 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-37b6424d-702d-4929-8e9d-790438b53f03 tempest-CreateVolumesFromImageTest-239099478 None] Created volume successfully. Apr 24 17:16:20 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a 1073741824" returned: 0 in 0.785s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:20 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a Apr 24 17:16:20 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:21 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a" returned: 0 in 0.478s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.654s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2022923892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa7125c-effa-4827-9a6d-2930e2c43039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c938257ec5e44db879522c101cfcf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:16Z,use_quota=True,user_id='f105af1d9e45481fbd5ac64f01b06086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Creating volume eaa7125c-effa-4827-9a6d-2930e2c43039 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:21 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34887347-ee74-41c5-a93e-8e5a2754561d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c82d23-eedc-4c9b-a024-a9326d12885a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:21 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039 1073741824 Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27fc8692-b9bd-4648-9a59-efa34e136f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:21 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:21 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume volume-04c82d23-eedc-4c9b-a024-a9326d12885a (04c82d23-eedc-4c9b-a024-a9326d12885a): created successfully Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27fc8692-b9bd-4648-9a59-efa34e136f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (3d87765c-4eeb-4cab-92fd-66a0143d4f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:21 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-49367191-a66c-48fb-b39e-0c1c0e03aedb tempest-CreateVolumesFromSnapshotTest-848436155 None] Created volume successfully. Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:21 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039 1073741824" returned: 0 in 0.725s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:21 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039 Apr 24 17:16:21 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:22 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039" returned: 0 in 0.484s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.639s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48723218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cee3f0-23f3-488b-8800-92fcb0e5a497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c938257ec5e44db879522c101cfcf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:17Z,use_quota=True,user_id='f105af1d9e45481fbd5ac64f01b06086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Creating volume 14cee3f0-23f3-488b-8800-92fcb0e5a497 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:22 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2d7d04-daf7-4123-a99b-2e8273ba5883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa7125c-effa-4827-9a6d-2930e2c43039', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9105c8d6-ad52-4252-b654-5ea388845935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:22 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497 1073741824 Apr 24 17:16:22 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:22 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Volume volume-eaa7125c-effa-4827-9a6d-2930e2c43039 (eaa7125c-effa-4827-9a6d-2930e2c43039): created successfully Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9105c8d6-ad52-4252-b654-5ea388845935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Flow 'volume_create_manager' (ade198bc-f06b-4417-8c72-b6381a23f414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:22 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-6903d112-ed38-427a-a80d-2b61b98e4949 tempest-CreateVolumesFromImageTest-239099478 None] Created volume successfully. Apr 24 17:16:23 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497 1073741824" returned: 0 in 0.682s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:23 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497 Apr 24 17:16:23 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:23 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497" returned: 0 in 0.519s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.565s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2052249789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2ea30d-3a2f-4291-800a-efbf8686e8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c938257ec5e44db879522c101cfcf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:17Z,use_quota=True,user_id='f105af1d9e45481fbd5ac64f01b06086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Creating volume ba2ea30d-3a2f-4291-800a-efbf8686e8ea {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:23 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ce8ff7-59d6-420e-beac-9c6464ef7f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14cee3f0-23f3-488b-8800-92fcb0e5a497', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0407cbf2-c0c3-44de-af4c-526d922dd76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:23 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea 1073741824 Apr 24 17:16:23 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:23 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Volume volume-14cee3f0-23f3-488b-8800-92fcb0e5a497 (14cee3f0-23f3-488b-8800-92fcb0e5a497): created successfully Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0407cbf2-c0c3-44de-af4c-526d922dd76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:23 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Flow 'volume_create_manager' (7b267bdf-32fb-4181-a3aa-7d58b211c37f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:23 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b45fc9a5-f9db-4eb9-bb48-e18286db49df tempest-CreateVolumesFromImageTest-239099478 None] Created volume successfully. Apr 24 17:16:24 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea 1073741824" returned: 0 in 0.670s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:24 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea Apr 24 17:16:24 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:24 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea" returned: 0 in 0.559s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.688s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] Creating offline snapshot 50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd of volume 4533ddf2-3883-430f-8753-97aa023c3b19 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:16:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5758316-08c8-4bd6-85d1-e3423c274d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be1537c-2243-4196-99d0-f675991ad19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:24 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[1767e06a-cb57-471b-9916-d46def0156d2]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:25 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Volume volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea (ba2ea30d-3a2f-4291-800a-efbf8686e8ea): created successfully Apr 24 17:16:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be1537c-2243-4196-99d0-f675991ad19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Flow 'volume_create_manager' (e7ae35f2-5e62-401a-9f0b-309f3fef312e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:25 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-03d2d8a1-0373-46a6-aad3-8dd9f519f206 tempest-CreateVolumesFromImageTest-239099478 None] Created volume successfully. Apr 24 17:16:25 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 Apr 24 17:16:25 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:25 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19" returned: 0 in 0.695s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:25 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd 1G Apr 24 17:16:25 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "cinder-ba2ea30d-3a2f-4291-800a-efbf8686e8ea-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-ba2ea30d-3a2f-4291-800a-efbf8686e8ea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "cinder-quobyte-ba2ea30d-3a2f-4291-800a-efbf8686e8ea" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-quobyte-ba2ea30d-3a2f-4291-800a-efbf8686e8ea" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:25 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[043a491a-7ceb-4e9f-8010-ca802aa05ff0]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:26 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea Apr 24 17:16:26 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:26 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd 1G" returned: 0 in 0.670s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4533ddf2-3883-430f-8753-97aa023c3b19 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:26 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4533ddf2-3883-430f-8753-97aa023c3b19 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd Apr 24 17:16:26 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:26 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea" returned: 0 in 0.602s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:26 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea Apr 24 17:16:26 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:26 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4533ddf2-3883-430f-8753-97aa023c3b19 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd" returned: 0 in 0.551s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:26 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd is being set with open permissions: ugo+rw Apr 24 17:16:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:26 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd Apr 24 17:16:26 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:27 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ba2ea30d-3a2f-4291-800a-efbf8686e8ea" returned: 0 in 0.572s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-quobyte-ba2ea30d-3a2f-4291-800a-efbf8686e8ea" released by "delete_volume" :: held 1.221s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Created reservations ['3c8a103e-1585-4819-9ac5-fd1649261ca0', 'a0913799-ccd3-4a38-a686-45573407cd3f', 'f5b896c7-06c0-426f-b22f-8e303fbe4eb2', '8cf10b3f-fcf7-43a7-9d4f-0a75b3791197'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:27 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:27 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:27 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd" returned: 0 in 0.527s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:27 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.info Apr 24 17:16:27 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:27 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.559s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:27 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Deleted volume successfully. Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a08b176d-f425-44dc-ae65-cf36ad71fc09 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-ba2ea30d-3a2f-4291-800a-efbf8686e8ea-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:27 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.info" returned: 0 in 0.478s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:27 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.info is being set with open permissions: ugo+rw Apr 24 17:16:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:27 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.info Apr 24 17:16:27 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "cinder-14cee3f0-23f3-488b-8800-92fcb0e5a497-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-14cee3f0-23f3-488b-8800-92fcb0e5a497-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "cinder-quobyte-14cee3f0-23f3-488b-8800-92fcb0e5a497" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-quobyte-14cee3f0-23f3-488b-8800-92fcb0e5a497" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a453493a-adbf-4dca-9490-b4e149c59a4f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:28 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497 Apr 24 17:16:28 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:28 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.info" returned: 0 in 0.546s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.593s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.834s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] Creating offline snapshot a3029c6c-501f-4469-aeca-ebbb1f6ab68d of volume 04c82d23-eedc-4c9b-a024-a9326d12885a {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:16:28 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e72c5491-03eb-40f4-875f-6f246b78f4a6 tempest-VolumeDependencyTests-960558612 None] Create snapshot completed successfully Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac494604-1c91-4c89-9f2c-064a9f263c23]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:28 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a Apr 24 17:16:28 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:28 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497" returned: 0 in 0.581s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:28 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497 Apr 24 17:16:28 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:29 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a" returned: 0 in 0.679s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:29 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d 1G Apr 24 17:16:29 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Flow 'volume_create_manager' (a0071834-4d67-403a-8749-7d6838648c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8b3f99-1ec2-4238-9a52-10ec30d1d21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8b3f99-1ec2-4238-9a52-10ec30d1d21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1921404185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835bf2bc-bfec-473a-8910-0e4356bd9e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0d232bd6ad4f5cb2e072db2fb0da58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:29Z,use_quota=True,user_id='67d64deebd7647fbafd3b73f9e336937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2f52f1-b555-4aec-9ae8-2eb95e3cf139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2f52f1-b555-4aec-9ae8-2eb95e3cf139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996c9fdf-02be-49ae-b6a7-3a41d01e3284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996c9fdf-02be-49ae-b6a7-3a41d01e3284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '835bf2bc-bfec-473a-8910-0e4356bd9e83', 'volume_name': 'volume-835bf2bc-bfec-473a-8910-0e4356bd9e83', 'volume_size': 1, 'snapshot_id': '50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e80ee5-ab1f-46e1-b2a0-074f03f502b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e80ee5-ab1f-46e1-b2a0-074f03f502b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf05edc-b33f-4039-afe4-003988b8d67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:29 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Volume 835bf2bc-bfec-473a-8910-0e4356bd9e83: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-835bf2bc-bfec-473a-8910-0e4356bd9e83', 'volume_size': 1, 'snapshot_id': '50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd'} Apr 24 17:16:29 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-14cee3f0-23f3-488b-8800-92fcb0e5a497" returned: 0 in 0.646s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-quobyte-14cee3f0-23f3-488b-8800-92fcb0e5a497" released by "delete_volume" :: held 1.276s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Created reservations ['5c63faaa-cf47-481e-9ed4-3c387201e7f4', 'afeb2373-0134-4d4e-a4a6-a858aaf974a8', '28be5693-bdbb-4556-9116-67f7675985ff', '4830c406-9070-4045-b845-855e5108f4f2'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:29 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:29 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:30 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d 1G" returned: 0 in 0.832s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c82d23-eedc-4c9b-a024-a9326d12885a -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:30 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c82d23-eedc-4c9b-a024-a9326d12885a -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d Apr 24 17:16:30 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:30 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.533s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:30 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Deleted volume successfully. Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-15ad11a3-0951-4d66-ac11-f95b4e2b1d15 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-14cee3f0-23f3-488b-8800-92fcb0e5a497-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "cinder-eaa7125c-effa-4827-9a6d-2930e2c43039-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-eaa7125c-effa-4827-9a6d-2930e2c43039-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "cinder-quobyte-eaa7125c-effa-4827-9a6d-2930e2c43039" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-quobyte-eaa7125c-effa-4827-9a6d-2930e2c43039" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[59de5da1-5a2c-472d-ab2a-b08600ecec3c]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:30 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039 Apr 24 17:16:30 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:30 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c82d23-eedc-4c9b-a024-a9326d12885a -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d" returned: 0 in 0.686s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:30 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d is being set with open permissions: ugo+rw Apr 24 17:16:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:30 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d Apr 24 17:16:30 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:31 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039" returned: 0 in 0.839s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:31 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039 Apr 24 17:16:31 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:31 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d" returned: 0 in 0.660s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:31 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.info Apr 24 17:16:31 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:31 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-eaa7125c-effa-4827-9a6d-2930e2c43039" returned: 0 in 0.584s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-quobyte-eaa7125c-effa-4827-9a6d-2930e2c43039" released by "delete_volume" :: held 1.467s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:31 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Created reservations ['4211ea80-cc0f-49bd-bd41-6f82fe7840ba', 'a7db244b-ead9-4e6f-8b91-882391093a72', 'ca318c63-d7f4-4f8b-ab1c-521afac62e18', '11d01cb3-5ec4-405a-9c33-2ec85ae39324'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:32 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.info" returned: 0 in 0.553s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:32 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.info is being set with open permissions: ugo+rw Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:32 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.info Apr 24 17:16:32 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:32 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:32 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:32 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.info" returned: 0 in 0.513s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.044s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.095s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-quobyte-50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd-835bf2bc-bfec-473a-8910-0e4356bd9e83" by "_create_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd-835bf2bc-bfec-473a-8910-0e4356bd9e83" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Creating volume 835bf2bc-bfec-473a-8910-0e4356bd9e83 from snapshot 50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd {{(pid=81986) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-quobyte-835bf2bc-bfec-473a-8910-0e4356bd9e83" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:32 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9b6c5781-0377-4ef4-8554-ee4893783a1d tempest-CreateVolumesFromSnapshotTest-848436155 None] Create snapshot completed successfully Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-835bf2bc-bfec-473a-8910-0e4356bd9e83" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] snapshot: 50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd, volume: 835bf2bc-bfec-473a-8910-0e4356bd9e83, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:16:32 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "cinder-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.620s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:32 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Deleted volume successfully. Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0919f2-395f-4100-94ba-f13dcbb8a5aa]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-c6b678b6-f82b-4bb5-bfd9-2f3d3879be5d tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-eaa7125c-effa-4827-9a6d-2930e2c43039-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "cinder-quobyte-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-quobyte-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:32 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd Apr 24 17:16:32 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95bbb57-69e5-4f91-87fd-138a036e0f9d]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:32 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f Apr 24 17:16:32 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:33 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd" returned: 0 in 0.687s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4533ddf2-3883-430f-8753-97aa023c3b19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd48150-c295-4166-aa4a-0585ea0b9c17]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:33 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f" returned: 0 in 0.663s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:33 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f Apr 24 17:16:33 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:33 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 Apr 24 17:16:33 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (83b099dd-9ddb-4d77-a306-160864171b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e69b8de-e4c7-409a-92ae-0a1d39889076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e69b8de-e4c7-409a-92ae-0a1d39889076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692920437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c3396e-43c5-4185-90d2-454b1a982226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:34Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0292195-2395-45b6-95be-609ff4aef3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0292195-2395-45b6-95be-609ff4aef3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef319d4-5f8f-4bd2-ab98-62a2e38dcac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef319d4-5f8f-4bd2-ab98-62a2e38dcac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c3396e-43c5-4185-90d2-454b1a982226', 'volume_name': 'volume-10c3396e-43c5-4185-90d2-454b1a982226', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4117d5-35cf-4d8c-8723-be8c9c4aec61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4117d5-35cf-4d8c-8723-be8c9c4aec61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d327a6-ac45-449f-b898-a621e95c809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:33 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume 10c3396e-43c5-4185-90d2-454b1a982226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c3396e-43c5-4185-90d2-454b1a982226', 'volume_size': 1} Apr 24 17:16:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (ca6d188d-dc55-4bda-a975-0eab7ae81f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc81df5-1731-477c-8388-7f165cbde035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc81df5-1731-477c-8388-7f165cbde035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701222412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af60a0b-cbfb-4b77-9ec3-94c47e3a8723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:34Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5312a7-102c-4672-8465-43a318903134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5312a7-102c-4672-8465-43a318903134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d1bf61-2f6c-4ba9-b940-15bb4c104a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d1bf61-2f6c-4ba9-b940-15bb4c104a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af60a0b-cbfb-4b77-9ec3-94c47e3a8723', 'volume_name': 'volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0829ab-8c99-4d17-92ac-12795f2b9225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0829ab-8c99-4d17-92ac-12795f2b9225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ed6632-665e-4d23-a035-15804d751a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:34 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume 9af60a0b-cbfb-4b77-9ec3-94c47e3a8723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723', 'volume_size': 1} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:34 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f" returned: 0 in 0.832s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-quobyte-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f" released by "delete_volume" :: held 1.549s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:34 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19" returned: 0 in 0.974s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:34 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 Apr 24 17:16:34 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (40ff276e-19eb-4d30-b6b0-61a9d99a01b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04e7186-7dc0-4e82-ba06-0e75bfe09f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04e7186-7dc0-4e82-ba06-0e75bfe09f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1158252848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f458f2-2702-49fc-8606-fe65a559c34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:34Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6434282-6a6a-4da9-82ea-e8fc96ebbd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6434282-6a6a-4da9-82ea-e8fc96ebbd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6642c735-6612-4b6c-a809-ac6b6fc969d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6642c735-6612-4b6c-a809-ac6b6fc969d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f458f2-2702-49fc-8606-fe65a559c34d', 'volume_name': 'volume-77f458f2-2702-49fc-8606-fe65a559c34d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b343251-95c7-4573-9495-efaed5122ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b343251-95c7-4573-9495-efaed5122ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a682689-e3c5-4e7e-8474-0a7dde88f92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:34 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume 77f458f2-2702-49fc-8606-fe65a559c34d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f458f2-2702-49fc-8606-fe65a559c34d', 'volume_size': 1} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Created reservations ['d7bbb4ee-df93-4856-ac02-6e6516576243', '8f8a083a-b430-4ee1-9275-e34ef2e73cfe', 'b5ce58d5-c07b-4d7d-936c-b78cdec24ed0', 'de79820e-2d8d-454f-902c-250171ef2806'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:34 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:34 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (df094127-d868-4b72-bd97-4316f204be34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c346261-9bb3-4776-a021-c41c484ecf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:34 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c346261-9bb3-4776-a021-c41c484ecf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2134293272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea67ca3-c22b-45af-9c51-656631c80ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:35Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601f7674-cc93-42e6-8062-c0673b7ea593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601f7674-cc93-42e6-8062-c0673b7ea593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d067d08-8829-4603-903d-533a2d516be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d067d08-8829-4603-903d-533a2d516be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea67ca3-c22b-45af-9c51-656631c80ebe', 'volume_name': 'volume-cea67ca3-c22b-45af-9c51-656631c80ebe', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b94c770-6347-4757-9353-e86af8b193ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b94c770-6347-4757-9353-e86af8b193ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccee1fb-df1a-4fda-b432-eaa02d70fc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:35 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume cea67ca3-c22b-45af-9c51-656631c80ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea67ca3-c22b-45af-9c51-656631c80ebe', 'volume_size': 1} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "cinder-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "cinder-quobyte-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-quobyte-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5" acquired by "delete_volume" :: waited 0.027s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ad6e27-a4f8-4b53-a8d5-b22ba1823e46]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:35 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5 Apr 24 17:16:35 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (2074e856-52c0-4b88-852a-b138257289a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cfce96-00e6-4ce9-8097-a214733233ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cfce96-00e6-4ce9-8097-a214733233ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1127133485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c40fa6-2bba-450c-a59c-22b47b0ee25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:36Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48806808-47ff-49e7-8a2a-b52a8d3825d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48806808-47ff-49e7-8a2a-b52a8d3825d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c5480b-24b3-4707-b36b-3d1de4cc0e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c5480b-24b3-4707-b36b-3d1de4cc0e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15c40fa6-2bba-450c-a59c-22b47b0ee25e', 'volume_name': 'volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:35 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a57246-7acc-4226-b93e-7436c713cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a57246-7acc-4226-b93e-7436c713cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f895ac6-4fef-4daf-8876-f9a5a6766c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:35 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume 15c40fa6-2bba-450c-a59c-22b47b0ee25e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e', 'volume_size': 1} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 1.230s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:35 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Deleted volume successfully. Apr 24 17:16:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bc3cc341-2de6-43da-8f43-ecb72139663c tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-b813ddb0-12a8-4c9c-90a6-c1d6ef656e8f-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:36 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5" returned: 0 in 1.445s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:36 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5 Apr 24 17:16:36 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:37 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5" returned: 0 in 1.307s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-quobyte-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5" released by "delete_volume" :: held 2.812s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:38 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Created reservations ['7d248339-0fd9-49c9-b0d0-6ce984fc5611', '55f7d6c3-baff-4fc3-a0d5-4c980143743f', 'f3ced4fd-5ed0-4996-9542-05898d078b6b', 'cf8def11-81e4-4480-921b-27166a7215ce'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:38 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:38 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:38 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:39 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 1.576s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:39 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:39 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Deleted volume successfully. Apr 24 17:16:39 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-87df3409-bac5-4c99-8378-e11b38a30913 tempest-CreateVolumesFromImageTest-239099478 None] Lock "cinder-8ee64148-6f7e-459e-bf8a-d2cc8dc7e0b5-delete_volume" released by "delete_volume" :: held 4.844s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Flow 'volume_create_manager' (886767f5-bcf7-4979-b17e-7200c49e4885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23371a6b-6191-4a7b-81f7-b25fdc6ab467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23371a6b-6191-4a7b-81f7-b25fdc6ab467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-110087769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df06f54-9543-4646-87a7-492f83caa583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129148edeea24b298ab3a259a0ada4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:40Z,use_quota=True,user_id='a1142b6ee6c24067a5697a21cf646171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6ef14d-ab44-4fe6-8795-913e9a3b8806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6ef14d-ab44-4fe6-8795-913e9a3b8806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ee683f-814f-4048-98ee-43a324d512f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ee683f-814f-4048-98ee-43a324d512f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df06f54-9543-4646-87a7-492f83caa583', 'volume_name': 'volume-9df06f54-9543-4646-87a7-492f83caa583', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811dd627-9306-405f-8a69-81553eaa3afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811dd627-9306-405f-8a69-81553eaa3afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49fa643c-7784-4fed-8339-9480b2e3418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:40 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Volume 9df06f54-9543-4646-87a7-492f83caa583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df06f54-9543-4646-87a7-492f83caa583', 'volume_size': 1} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:40 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83" returned: 0 in 6.518s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a929193a-39c8-4b97-919d-372467b297fd]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:41 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 Apr 24 17:16:41 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:41 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19" returned: 0 in 0.685s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:41 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:16:41 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Converted 1024.00 MB image at 157.08 MB/s Apr 24 17:16:41 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 is being set with open permissions: ugo+rw Apr 24 17:16:41 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:41 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 Apr 24 17:16:41 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:42 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83" returned: 0 in 0.468s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-835bf2bc-bfec-473a-8910-0e4356bd9e83" released by "_copy_volume_from_snapshot" :: held 9.469s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd-835bf2bc-bfec-473a-8910-0e4356bd9e83" released by "_create_volume_from_snapshot" :: held 9.527s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.553s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.409s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692920437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c3396e-43c5-4185-90d2-454b1a982226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:34Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Creating volume 10c3396e-43c5-4185-90d2-454b1a982226 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:42 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:42 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226 1073741824 Apr 24 17:16:42 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf05edc-b33f-4039-afe4-003988b8d67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835bf2bc-bfec-473a-8910-0e4356bd9e83', 'volume_size': 1, 'snapshot_id': '50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78ebe07-8bda-4067-b4b2-2cac77897ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:42 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Volume volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 (835bf2bc-bfec-473a-8910-0e4356bd9e83): created successfully Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78ebe07-8bda-4067-b4b2-2cac77897ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Flow 'volume_create_manager' (a0071834-4d67-403a-8749-7d6838648c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:42 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-39ba7c80-f3d9-4160-b23e-e0a4c32379cd tempest-VolumeDependencyTests-960558612 None] Created volume successfully. Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Lock "cinder-50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-quobyte-4533ddf2-3883-430f-8753-97aa023c3b19" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-4533ddf2-3883-430f-8753-97aa023c3b19" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-quobyte-50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Deleting offline snapshot 50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd of volume 4533ddf2-3883-430f-8753-97aa023c3b19 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] snapshot_file for this snap is: volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[da269273-ed13-4018-b002-babbc6d1cf37]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:42 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd Apr 24 17:16:42 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (0bc5e4be-cdd4-4350-a0dc-37881f3bde3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3468db7a-8ec5-4a78-9b42-c1463cf9d098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3468db7a-8ec5-4a78-9b42-c1463cf9d098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-351255211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95a091f-3941-4521-b99a-80156e155664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:43Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36c56a5-5de6-44db-9317-4c084280091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36c56a5-5de6-44db-9317-4c084280091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb10e73-73c1-4bbc-a570-3b1fe73cf50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb10e73-73c1-4bbc-a570-3b1fe73cf50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a95a091f-3941-4521-b99a-80156e155664', 'volume_name': 'volume-a95a091f-3941-4521-b99a-80156e155664', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a25729-60c7-4be4-9c44-cab97a1499a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a25729-60c7-4be4-9c44-cab97a1499a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bc62f6-7959-4222-b03c-458ff58ad55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:42 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume a95a091f-3941-4521-b99a-80156e155664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a95a091f-3941-4521-b99a-80156e155664', 'volume_size': 1} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:42 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226 1073741824" returned: 0 in 0.682s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:42 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:42 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226 Apr 24 17:16:42 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:43 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd" returned: 0 in 0.571s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4533ddf2-3883-430f-8753-97aa023c3b19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[324b1ec9-76b4-4529-a145-44fae0e353b0]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:43 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 Apr 24 17:16:43 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:43 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226" returned: 0 in 0.453s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.021s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701222412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af60a0b-cbfb-4b77-9ec3-94c47e3a8723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:34Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Creating volume 9af60a0b-cbfb-4b77-9ec3-94c47e3a8723 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:43 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d327a6-ac45-449f-b898-a621e95c809c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c3396e-43c5-4185-90d2-454b1a982226', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c178a51e-51a2-4794-816e-05aac4c7ef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:43 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723 1073741824 Apr 24 17:16:43 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:43 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume volume-10c3396e-43c5-4185-90d2-454b1a982226 (10c3396e-43c5-4185-90d2-454b1a982226): created successfully Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c178a51e-51a2-4794-816e-05aac4c7ef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (83b099dd-9ddb-4d77-a306-160864171b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:43 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a491c1a4-8390-4328-b793-ae4f0e5709bb tempest-CreateVolumesFromSnapshotTest-848436155 None] Created volume successfully. Apr 24 17:16:43 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19" returned: 0 in 0.558s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:43 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:43 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd Apr 24 17:16:43 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:44 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723 1073741824" returned: 0 in 0.671s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:44 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723 Apr 24 17:16:44 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:44 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd" returned: 0 in 0.615s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:44 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd Apr 24 17:16:44 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:44 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723" returned: 0 in 0.479s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.003s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1158252848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f458f2-2702-49fc-8606-fe65a559c34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:34Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Creating volume 77f458f2-2702-49fc-8606-fe65a559c34d {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:44 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ed6632-665e-4d23-a035-15804d751a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ae8929-f7e4-461b-9da6-f98cb0e08266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:44 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d 1073741824 Apr 24 17:16:44 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:44 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723 (9af60a0b-cbfb-4b77-9ec3-94c47e3a8723): created successfully Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ae8929-f7e4-461b-9da6-f98cb0e08266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (ca6d188d-dc55-4bda-a975-0eab7ae81f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:44 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-354f457c-8133-4d42-8763-6b83b7616ce1 tempest-CreateVolumesFromSnapshotTest-848436155 None] Created volume successfully. Apr 24 17:16:44 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19.50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd" returned: 0 in 0.464s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd" released by "_delete_snapshot" :: held 2.327s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-4533ddf2-3883-430f-8753-97aa023c3b19" released by "delete_snapshot" :: held 2.352s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Created reservations ['f6f4a50d-71d2-47d2-94a4-1957a86d136a', 'cf362a6b-abc8-4533-bb96-9a4038e2249a', '2a35c4a9-bf4c-4461-bf04-393d86c8c262', '278a5755-b943-498e-984c-bda2611ad64f'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:44 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Delete snapshot completed successfully. Apr 24 17:16:44 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f6978eeb-e121-4f2d-b6b8-0a71e8f02ced tempest-VolumeDependencyTests-960558612 None] Lock "cinder-50ae3d5a-b22f-4fbf-9f7e-29dd1056fbfd-delete_snapshot" released by "delete_snapshot" :: held 2.492s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:45 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d 1073741824" returned: 0 in 0.641s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:45 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d Apr 24 17:16:45 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-4533ddf2-3883-430f-8753-97aa023c3b19-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-4533ddf2-3883-430f-8753-97aa023c3b19-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:45 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d" returned: 0 in 0.468s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.629s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2134293272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea67ca3-c22b-45af-9c51-656631c80ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:35Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Creating volume cea67ca3-c22b-45af-9c51-656631c80ebe {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:45 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:45 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe 1073741824 Apr 24 17:16:45 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a682689-e3c5-4e7e-8474-0a7dde88f92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f458f2-2702-49fc-8606-fe65a559c34d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2523bdd8-6a64-4db5-b663-72e336ba851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:45 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume volume-77f458f2-2702-49fc-8606-fe65a559c34d (77f458f2-2702-49fc-8606-fe65a559c34d): created successfully Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2523bdd8-6a64-4db5-b663-72e336ba851e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (40ff276e-19eb-4d30-b6b0-61a9d99a01b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-quobyte-4533ddf2-3883-430f-8753-97aa023c3b19" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:45 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-313d469d-3ebb-4d48-b83a-83c34e5eb954 tempest-CreateVolumesFromSnapshotTest-848436155 None] Created volume successfully. Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-4533ddf2-3883-430f-8753-97aa023c3b19" acquired by "delete_volume" :: waited 0.030s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[728ed2b7-cb84-42f8-af19-636434105221]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:45 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:45 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 Apr 24 17:16:45 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:46 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe 1073741824" returned: 0 in 0.614s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:46 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe Apr 24 17:16:46 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:46 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19" returned: 0 in 0.532s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:46 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19 Apr 24 17:16:46 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:46 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe" returned: 0 in 0.469s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.951s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1127133485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c40fa6-2bba-450c-a59c-22b47b0ee25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db408e2f88c442eca03d27764df5e48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:36Z,use_quota=True,user_id='2338edb4a9344c1e99a2f5de100b261b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Creating volume 15c40fa6-2bba-450c-a59c-22b47b0ee25e {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:46 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:46 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-4533ddf2-3883-430f-8753-97aa023c3b19" returned: 0 in 0.461s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:46 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e 1073741824 Apr 24 17:16:46 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccee1fb-df1a-4fda-b432-eaa02d70fc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea67ca3-c22b-45af-9c51-656631c80ebe', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0615f9f-8379-4889-a666-efdc4ea666b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-4533ddf2-3883-430f-8753-97aa023c3b19" released by "delete_volume" :: held 1.065s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:46 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume volume-cea67ca3-c22b-45af-9c51-656631c80ebe (cea67ca3-c22b-45af-9c51-656631c80ebe): created successfully Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0615f9f-8379-4889-a666-efdc4ea666b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (df094127-d868-4b72-bd97-4316f204be34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:46 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-b5822da1-3d95-4cb0-a277-dda86dcc97b0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Created volume successfully. Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Created reservations ['9ce24c13-87b7-4d3b-a71d-7bc6f0fd0a74', 'ccd0a11d-f4ec-497e-9802-a5ee14a2c83f', 'c468de33-641b-4a53-be23-ae59c2d97e7f', 'cbe73157-21fa-40da-b469-ee0c43fe769d'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:46 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:47 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:47 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:47 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.458s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:47 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:47 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Deleted volume successfully. Apr 24 17:16:47 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f1cd16b0-003c-4bdd-930a-b5e0dbb3e632 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-4533ddf2-3883-430f-8753-97aa023c3b19-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:47 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e 1073741824" returned: 0 in 0.678s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:47 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e Apr 24 17:16:47 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:47 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e" returned: 0 in 0.452s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:47 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:47 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.670s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-110087769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df06f54-9543-4646-87a7-492f83caa583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129148edeea24b298ab3a259a0ada4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:40Z,use_quota=True,user_id='a1142b6ee6c24067a5697a21cf646171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Creating volume 9df06f54-9543-4646-87a7-492f83caa583 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:48 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f895ac6-4fef-4daf-8876-f9a5a6766c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:48 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 1073741824 Apr 24 17:16:48 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ca4bae-e697-47da-ada3-bd49087a42b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:48 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Volume volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e (15c40fa6-2bba-450c-a59c-22b47b0ee25e): created successfully Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ca4bae-e697-47da-ada3-bd49087a42b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Flow 'volume_create_manager' (2074e856-52c0-4b88-852a-b138257289a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:48 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-aa98e49a-0847-4fd5-b826-f51ced5fbad5 tempest-CreateVolumesFromSnapshotTest-848436155 None] Created volume successfully. Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Flow 'volume_create_manager' (8c934ccb-a437-40f0-b654-d58a8882148d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685a64fa-4766-448e-a779-994f4b77d59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685a64fa-4766-448e-a779-994f4b77d59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-45718931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04de4f3-650c-497b-908c-8af9c41a7b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0d232bd6ad4f5cb2e072db2fb0da58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:48Z,use_quota=True,user_id='67d64deebd7647fbafd3b73f9e336937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f227bd-831c-4025-8b14-df8ea26a9803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f227bd-831c-4025-8b14-df8ea26a9803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7f3c6a-6040-4ca4-b892-8e41fcec9907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7f3c6a-6040-4ca4-b892-8e41fcec9907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a04de4f3-650c-497b-908c-8af9c41a7b6d', 'volume_name': 'volume-a04de4f3-650c-497b-908c-8af9c41a7b6d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d5b0f3-dede-4705-b744-a1bea9c55aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d5b0f3-dede-4705-b744-a1bea9c55aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07474f8-91e3-401e-bd77-1f1de5c0f1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:48 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Volume a04de4f3-650c-497b-908c-8af9c41a7b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a04de4f3-650c-497b-908c-8af9c41a7b6d', 'volume_size': 1} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:48 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 1073741824" returned: 0 in 0.670s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:48 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 Apr 24 17:16:48 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-15c40fa6-2bba-450c-a59c-22b47b0ee25e-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-15c40fa6-2bba-450c-a59c-22b47b0ee25e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-quobyte-15c40fa6-2bba-450c-a59c-22b47b0ee25e" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-15c40fa6-2bba-450c-a59c-22b47b0ee25e" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4f485c-b8b2-467b-9cdf-f057625ae420]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:48 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:48 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e Apr 24 17:16:48 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:49 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583" returned: 0 in 0.474s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.404s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-351255211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95a091f-3941-4521-b99a-80156e155664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:43Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Creating volume a95a091f-3941-4521-b99a-80156e155664 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:49 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49fa643c-7784-4fed-8339-9480b2e3418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df06f54-9543-4646-87a7-492f83caa583', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dea5de-ee66-45ed-84f8-88cafdde3c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:49 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664 1073741824 Apr 24 17:16:49 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:49 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Volume volume-9df06f54-9543-4646-87a7-492f83caa583 (9df06f54-9543-4646-87a7-492f83caa583): created successfully Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dea5de-ee66-45ed-84f8-88cafdde3c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Flow 'volume_create_manager' (886767f5-bcf7-4979-b17e-7200c49e4885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:49 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-0bea2a81-ac11-4ad4-95a4-b69aee35d206 tempest-SnapshotDependencyTests-1405310532 None] Created volume successfully. Apr 24 17:16:49 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e" returned: 0 in 0.553s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:49 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e Apr 24 17:16:49 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:49 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664 1073741824" returned: 0 in 0.654s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:49 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664 Apr 24 17:16:49 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:49 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-15c40fa6-2bba-450c-a59c-22b47b0ee25e" returned: 0 in 0.506s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:49 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-15c40fa6-2bba-450c-a59c-22b47b0ee25e" released by "delete_volume" :: held 1.105s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Created reservations ['eac62c44-a043-4cdc-9ff8-817cb8b8a43b', '61007ee0-470d-42dd-a68e-cac441ab93b6', 'f2b3abf5-6a8c-4c0d-9f40-3ee50fa6f85e', '9b440d5e-c8a4-4e23-a674-0cddf2df9aa0'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:50 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:50 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:50 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664" returned: 0 in 0.539s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.191s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-45718931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04de4f3-650c-497b-908c-8af9c41a7b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0d232bd6ad4f5cb2e072db2fb0da58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:48Z,use_quota=True,user_id='67d64deebd7647fbafd3b73f9e336937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Creating volume a04de4f3-650c-497b-908c-8af9c41a7b6d {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:50 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bc62f6-7959-4222-b03c-458ff58ad55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95a091f-3941-4521-b99a-80156e155664', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:50 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d 1073741824 Apr 24 17:16:50 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138b9c9a-c536-4bbe-8165-3ab9200ba9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:50 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume volume-a95a091f-3941-4521-b99a-80156e155664 (a95a091f-3941-4521-b99a-80156e155664): created successfully Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138b9c9a-c536-4bbe-8165-3ab9200ba9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (0bc5e4be-cdd4-4350-a0dc-37881f3bde3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:50 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-aad855b4-ad32-45b8-be57-ef1b79412c0b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created volume successfully. Apr 24 17:16:50 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.453s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:50 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Deleted volume successfully. Apr 24 17:16:50 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-08ab7240-e9ab-4eae-9d3b-9327e58e70e0 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-15c40fa6-2bba-450c-a59c-22b47b0ee25e-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-cea67ca3-c22b-45af-9c51-656631c80ebe-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-cea67ca3-c22b-45af-9c51-656631c80ebe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:51 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d 1073741824" returned: 0 in 0.663s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-quobyte-cea67ca3-c22b-45af-9c51-656631c80ebe" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-cea67ca3-c22b-45af-9c51-656631c80ebe" acquired by "delete_volume" :: waited 0.038s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7b620c-692a-453e-9976-739d4a62ca4b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:51 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d Apr 24 17:16:51 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:51 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe Apr 24 17:16:51 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (78dfd855-0a8c-4b47-a2ea-e26843d10476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc239eed-a305-4fb4-a215-b1ca1ee64f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc239eed-a305-4fb4-a215-b1ca1ee64f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-619766779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bfb815-570e-4b04-a8e6-e683a20c68a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:52Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a2b91a-5da3-4c38-a06b-595e0435a66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a2b91a-5da3-4c38-a06b-595e0435a66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecb0a07-575e-47b3-8fb0-13b026fb7e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecb0a07-575e-47b3-8fb0-13b026fb7e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7bfb815-570e-4b04-a8e6-e683a20c68a0', 'volume_name': 'volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f89303-e48b-4534-891e-41d9039db314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f89303-e48b-4534-891e-41d9039db314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4817481-04c9-40a6-a9f4-b07c7095b408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:51 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume a7bfb815-570e-4b04-a8e6-e683a20c68a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0', 'volume_size': 1} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:51 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d" returned: 0 in 0.498s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.604s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] Creating offline snapshot 3cf662c1-6277-4e28-bfc8-f843b4e41422 of volume 9df06f54-9543-4646-87a7-492f83caa583 {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07474f8-91e3-401e-bd77-1f1de5c0f1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04de4f3-650c-497b-908c-8af9c41a7b6d', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13fcf69-47b7-43aa-93a4-d6f476bed868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02ca765-ebce-4881-ac4a-38edd5a3659f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:51 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Volume volume-a04de4f3-650c-497b-908c-8af9c41a7b6d (a04de4f3-650c-497b-908c-8af9c41a7b6d): created successfully Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13fcf69-47b7-43aa-93a4-d6f476bed868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Flow 'volume_create_manager' (8c934ccb-a437-40f0-b654-d58a8882148d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:51 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-9f72fe62-57aa-4fae-8b62-ab112db32840 tempest-VolumeDependencyTests-960558612 None] Created volume successfully. Apr 24 17:16:51 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe" returned: 0 in 0.606s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:51 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe Apr 24 17:16:51 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:51 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 Apr 24 17:16:51 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (144f7671-8b2f-4a30-9d47-009273f47654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb6ec4b-dd81-4dec-a421-6e9b8ce6d453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb6ec4b-dd81-4dec-a421-6e9b8ce6d453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651447321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6ebe0a-3624-43c4-9620-a9bcc46cdc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:52Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfe6417-430b-48c6-8e9f-b11987e51ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfe6417-430b-48c6-8e9f-b11987e51ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122b07f9-c51a-43d2-8a25-1c1821cbb98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122b07f9-c51a-43d2-8a25-1c1821cbb98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6ebe0a-3624-43c4-9620-a9bcc46cdc59', 'volume_name': 'volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551eaf29-fd52-4510-817f-7e7c3cbacabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551eaf29-fd52-4510-817f-7e7c3cbacabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0228d7-8d45-45af-9dc0-86cba9babfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:51 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume 6c6ebe0a-3624-43c4-9620-a9bcc46cdc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59', 'volume_size': 1} Apr 24 17:16:51 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (23170316-6811-4c15-9c32-7787819d6062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2956f0-521b-4bfd-96c3-43b7403bb785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2956f0-521b-4bfd-96c3-43b7403bb785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-63612259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f07bd2-3627-4bd0-a74c-b0ccf82ff54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:52Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8c74ff-e124-4f8f-afc2-dcfc6888c85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8c74ff-e124-4f8f-afc2-dcfc6888c85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13b2ddf-b0c0-4f9a-a4bd-268d3dd10857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13b2ddf-b0c0-4f9a-a4bd-268d3dd10857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f07bd2-3627-4bd0-a74c-b0ccf82ff54a', 'volume_name': 'volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a66691-ed95-4580-9e3a-cdf76d1abee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a66691-ed95-4580-9e3a-cdf76d1abee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55aaaff1-60cc-4436-9f21-99f8ec3b23eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume 26f07bd2-3627-4bd0-a74c-b0ccf82ff54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a', 'volume_size': 1} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:52 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-cea67ca3-c22b-45af-9c51-656631c80ebe" returned: 0 in 0.674s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:52 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-cea67ca3-c22b-45af-9c51-656631c80ebe" released by "delete_volume" :: held 1.330s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583" returned: 0 in 0.767s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:52 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 1G Apr 24 17:16:52 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (4e055a53-9225-4577-b2ea-f0f2b2aef474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d5121e-9499-4bb2-9a95-886400615a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d5121e-9499-4bb2-9a95-886400615a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-555960075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac5fd085-55e2-42f7-9396-326954aaf382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:52Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0703350-7405-4180-89a2-8be85f177d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0703350-7405-4180-89a2-8be85f177d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd79ebe-37ec-4088-97f1-059de4977633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd79ebe-37ec-4088-97f1-059de4977633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac5fd085-55e2-42f7-9396-326954aaf382', 'volume_name': 'volume-ac5fd085-55e2-42f7-9396-326954aaf382', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac199a0-f409-40db-b689-b1b14ee6bbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac199a0-f409-40db-b689-b1b14ee6bbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a127ffe-1f8b-46d7-bc51-4331e54a539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume ac5fd085-55e2-42f7-9396-326954aaf382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac5fd085-55e2-42f7-9396-326954aaf382', 'volume_size': 1} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Created reservations ['fd1f3f99-e2f1-4c84-bb87-cb50007f4a8a', 'bb90a875-f337-47f6-b212-8bb1005eac64', '14fbca43-c19d-498f-9849-b23bba0db3a6', '3072a892-4aaa-4dc5-a218-f2d047532e7b'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG oslo_db.api [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Apr 24 17:16:52 devstack cinder-volume[81986]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Apr 24 17:16:52 devstack cinder-volume[81986]: FROM reservations Apr 24 17:16:52 devstack cinder-volume[81986]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s) FOR UPDATE] Apr 24 17:16:52 devstack cinder-volume[81986]: [parameters: {'uuid_1_1': 'fd1f3f99-e2f1-4c84-bb87-cb50007f4a8a', 'uuid_1_2': 'bb90a875-f337-47f6-b212-8bb1005eac64', 'uuid_1_3': '14fbca43-c19d-498f-9849-b23bba0db3a6', 'uuid_1_4': '3072a892-4aaa-4dc5-a218-f2d047532e7b'}] Apr 24 17:16:52 devstack cinder-volume[81986]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=81986) _is_exception_expected /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:184}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG oslo_db.api [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Performing DB retry for function cinder.db.sqlalchemy.api.reservation_commit {{(pid=81986) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:155}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (a1a8315c-7566-468a-b032-cd748afb6483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207d9358-56f9-4852-bcb7-422a5d93a6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207d9358-56f9-4852-bcb7-422a5d93a6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133238078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e34fcb9-1d14-4f80-ade4-118516fc6cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:53Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25895105-ab8c-483f-9beb-d891d95f8e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25895105-ab8c-483f-9beb-d891d95f8e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8f8b0d-6dad-4d0c-a99f-c1614c25a781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8f8b0d-6dad-4d0c-a99f-c1614c25a781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e34fcb9-1d14-4f80-ade4-118516fc6cdb', 'volume_name': 'volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51c0fe4-be05-40e9-89ef-bd43aef714cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51c0fe4-be05-40e9-89ef-bd43aef714cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751428b4-0322-4819-a2c4-6b2b09ad594a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:52 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume 6e34fcb9-1d14-4f80-ade4-118516fc6cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb', 'volume_size': 1} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:52 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Flow 'volume_create_manager' (edbec9a3-c6cc-42b9-a975-e774efaddf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb72eae-461a-4449-ab51-1b95fd51e841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb72eae-461a-4449-ab51-1b95fd51e841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1722080275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab57d624-2932-4160-af9e-4e4cd8d37b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0d232bd6ad4f5cb2e072db2fb0da58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a04de4f3-650c-497b-908c-8af9c41a7b6d,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:53Z,use_quota=True,user_id='67d64deebd7647fbafd3b73f9e336937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abf3193-4d9d-45e6-91c4-42687f7b3260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abf3193-4d9d-45e6-91c4-42687f7b3260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb57d365-7aba-4bff-8e02-c207cb48cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb57d365-7aba-4bff-8e02-c207cb48cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ab57d624-2932-4160-af9e-4e4cd8d37b40', 'volume_name': 'volume-ab57d624-2932-4160-af9e-4e4cd8d37b40', 'volume_size': 1, 'source_volid': 'a04de4f3-650c-497b-908c-8af9c41a7b6d', 'source_volstatus': 'available'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca56e39-d89f-43ea-8e2f-663512725a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca56e39-d89f-43ea-8e2f-663512725a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619550b3-ce52-412b-97f4-4d428097f130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:53 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Volume ab57d624-2932-4160-af9e-4e4cd8d37b40: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ab57d624-2932-4160-af9e-4e4cd8d37b40', 'volume_size': 1, 'source_volid': 'a04de4f3-650c-497b-908c-8af9c41a7b6d', 'source_volstatus': 'available'} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:53 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 1G" returned: 0 in 0.766s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df06f54-9543-4646-87a7-492f83caa583 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:53 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df06f54-9543-4646-87a7-492f83caa583 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 Apr 24 17:16:53 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-77f458f2-2702-49fc-8606-fe65a559c34d-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-77f458f2-2702-49fc-8606-fe65a559c34d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-quobyte-77f458f2-2702-49fc-8606-fe65a559c34d" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-77f458f2-2702-49fc-8606-fe65a559c34d" acquired by "delete_volume" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c37932-eab8-4d30-90dd-01c9133e83dc]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:53 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d Apr 24 17:16:53 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:53 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:53 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:53 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df06f54-9543-4646-87a7-492f83caa583 -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422" returned: 0 in 0.559s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:53 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 is being set with open permissions: ugo+rw Apr 24 17:16:53 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:53 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 Apr 24 17:16:53 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:54 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d" returned: 0 in 0.570s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:54 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d Apr 24 17:16:54 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:54 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.473s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:54 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Deleted volume successfully. Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-8891f294-c302-43ea-8961-c3b07f3262c8 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-cea67ca3-c22b-45af-9c51-656631c80ebe-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:54 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422" returned: 0 in 0.492s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:54 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.info Apr 24 17:16:54 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:54 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-77f458f2-2702-49fc-8606-fe65a559c34d" returned: 0 in 0.481s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-77f458f2-2702-49fc-8606-fe65a559c34d" released by "delete_volume" :: held 1.110s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Created reservations ['a662d136-bac0-46d2-a779-43bdfb193f11', '20bee424-4c67-4404-bc9d-73edd029f5ae', '7405f460-c9c8-4183-94c5-e9875c2658af', '4c470794-4561-4e93-97ac-22dbfaf2b10b'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:54 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:54 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:54 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.info" returned: 0 in 0.500s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:54 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.info is being set with open permissions: ugo+rw Apr 24 17:16:54 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:54 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.info Apr 24 17:16:54 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:55 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.468s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:55 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Deleted volume successfully. Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2accd615-758c-4515-959f-1e211734c2fe tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-77f458f2-2702-49fc-8606-fe65a559c34d-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:55 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.info" returned: 0 in 0.471s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.655s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.682s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-619766779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bfb815-570e-4b04-a8e6-e683a20c68a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:52Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Creating volume a7bfb815-570e-4b04-a8e6-e683a20c68a0 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:55 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:55 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0 1073741824 Apr 24 17:16:55 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:55 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2719ae96-612e-4ad4-af98-71f523e0fc41 tempest-SnapshotDependencyTests-1405310532 None] Create snapshot completed successfully Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-quobyte-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723" acquired by "delete_volume" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[65300bc7-a03a-4262-953a-985a1384f6a9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:55 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723 Apr 24 17:16:55 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:55 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:55 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0 1073741824" returned: 0 in 0.628s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:56 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0 Apr 24 17:16:56 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:56 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723" returned: 0 in 0.567s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:56 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723 Apr 24 17:16:56 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:56 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0" returned: 0 in 0.469s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.506s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651447321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6ebe0a-3624-43c4-9620-a9bcc46cdc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:52Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Creating volume 6c6ebe0a-3624-43c4-9620-a9bcc46cdc59 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:56 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4817481-04c9-40a6-a9f4-b07c7095b408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7e0f1d-5f95-43f7-bac0-1fed4e17364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:56 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59 1073741824 Apr 24 17:16:56 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:56 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0 (a7bfb815-570e-4b04-a8e6-e683a20c68a0): created successfully Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7e0f1d-5f95-43f7-bac0-1fed4e17364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (78dfd855-0a8c-4b47-a2ea-e26843d10476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:56 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-931e2b18-851a-49b3-9d2b-cc0873da43e8 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created volume successfully. Apr 24 17:16:56 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723" returned: 0 in 0.494s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723" released by "delete_volume" :: held 1.108s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Created reservations ['c582e766-c197-4ab5-b2eb-d31fb9f93304', '8887b49c-9f97-4e8b-9e58-94a213e340e9', '90e5ab5b-84f7-4173-b255-0e362dab2428', '7cc5676c-3173-401c-9cbd-07deffc9af75'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Flow 'volume_create_manager' (a0bed695-ea72-44e5-940a-1dcb2099c262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3933b21-ee21-400f-960a-ee276d49e87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3933b21-ee21-400f-960a-ee276d49e87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12c2398-17a8-4a2a-bad5-7b86ca7ddf66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129148edeea24b298ab3a259a0ada4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3cf662c1-6277-4e28-bfc8-f843b4e41422,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:57Z,use_quota=True,user_id='a1142b6ee6c24067a5697a21cf646171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5ddf93-298e-48b1-a17e-3bff52dd77b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5ddf93-298e-48b1-a17e-3bff52dd77b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85838b0-d69a-4e49-9188-8d99d0a524bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85838b0-d69a-4e49-9188-8d99d0a524bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c12c2398-17a8-4a2a-bad5-7b86ca7ddf66', 'volume_name': 'volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66', 'volume_size': 1, 'snapshot_id': '3cf662c1-6277-4e28-bfc8-f843b4e41422'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616a2f9f-aecb-4cc8-8b6d-d0947ace63df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616a2f9f-aecb-4cc8-8b6d-d0947ace63df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c6f2b8-f854-4c25-bfe7-2e23207ba29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:56 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Volume c12c2398-17a8-4a2a-bad5-7b86ca7ddf66: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66', 'volume_size': 1, 'snapshot_id': '3cf662c1-6277-4e28-bfc8-f843b4e41422'} Apr 24 17:16:56 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:57 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:57 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:57 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59 1073741824" returned: 0 in 0.672s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:57 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59 Apr 24 17:16:57 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:57 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.477s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:57 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Deleted volume successfully. Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-2429011d-b454-4db2-9444-fcda275d65ea tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-9af60a0b-cbfb-4b77-9ec3-94c47e3a8723-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:57 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59" returned: 0 in 0.466s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.313s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-63612259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f07bd2-3627-4bd0-a74c-b0ccf82ff54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:52Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Creating volume 26f07bd2-3627-4bd0-a74c-b0ccf82ff54a {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:57 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:57 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a 1073741824 Apr 24 17:16:57 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0228d7-8d45-45af-9dc0-86cba9babfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1706965-b6f8-4478-90ed-848f463bb4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:57 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59 (6c6ebe0a-3624-43c4-9620-a9bcc46cdc59): created successfully Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1706965-b6f8-4478-90ed-848f463bb4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (144f7671-8b2f-4a30-9d47-009273f47654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:57 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-85c0d2f7-1747-4eca-af4f-b5aa308ca7f5 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created volume successfully. Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-10c3396e-43c5-4185-90d2-454b1a982226-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-10c3396e-43c5-4185-90d2-454b1a982226-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-quobyte-10c3396e-43c5-4185-90d2-454b1a982226" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-10c3396e-43c5-4185-90d2-454b1a982226" acquired by "delete_volume" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83e5a0c-ee9c-4eb9-a6c6-da472ddcf662]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:16:57 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:58 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226 Apr 24 17:16:58 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:58 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a 1073741824" returned: 0 in 0.724s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:UPDATE=158,cinder:SELECT=132,cinder:INSERT=38,cinder:DELETE=18 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:58 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a Apr 24 17:16:58 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:58 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226" returned: 0 in 0.555s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:58 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226 Apr 24 17:16:58 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:58 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a" returned: 0 in 0.481s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.322s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-555960075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac5fd085-55e2-42f7-9396-326954aaf382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:52Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Creating volume ac5fd085-55e2-42f7-9396-326954aaf382 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:16:58 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:58 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55aaaff1-60cc-4436-9f21-99f8ec3b23eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:58 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382 1073741824 Apr 24 17:16:58 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08098ff0-f02a-40e1-8c27-47b094893fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:16:58 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-10c3396e-43c5-4185-90d2-454b1a982226" returned: 0 in 0.491s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:59 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a (26f07bd2-3627-4bd0-a74c-b0ccf82ff54a): created successfully Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08098ff0-f02a-40e1-8c27-47b094893fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (23170316-6811-4c15-9c32-7787819d6062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-10c3396e-43c5-4185-90d2-454b1a982226" released by "delete_volume" :: held 1.104s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:16:59 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-1ba4e938-06ab-4284-9f7c-546a577fd337 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created volume successfully. Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Created reservations ['f6cfb782-5680-4cd3-ad2a-7a9563b5cb2c', '7563ec4d-84bc-4a13-81ea-425650328d07', 'ac1ed677-54dd-4377-be81-97cc10e5170e', '32aa809a-33b0-453c-a793-b6a37a0502c0'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:59 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:16:59 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:59 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382 1073741824" returned: 0 in 0.645s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:59 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.493s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:16:59 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Deleted volume successfully. Apr 24 17:16:59 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382 Apr 24 17:16:59 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:16:59 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a821af16-fcf7-439c-a9e6-ae865bc1f984 tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-10c3396e-43c5-4185-90d2-454b1a982226-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-a3029c6c-501f-4469-aeca-ebbb1f6ab68d-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-a3029c6c-501f-4469-aeca-ebbb1f6ab68d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-quobyte-04c82d23-eedc-4c9b-a024-a9326d12885a" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:00 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382" returned: 0 in 0.488s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.173s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133238078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e34fcb9-1d14-4f80-ade4-118516fc6cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93fde59828140d6b9c24bb4a16e0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:16:53Z,use_quota=True,user_id='395c287380d94e6f818cec524b88cdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Creating volume 6e34fcb9-1d14-4f80-ade4-118516fc6cdb {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:17:00 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-04c82d23-eedc-4c9b-a024-a9326d12885a" acquired by "delete_snapshot" :: waited 0.045s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-quobyte-a3029c6c-501f-4469-aeca-ebbb1f6ab68d" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:00 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb 1073741824 Apr 24 17:17:00 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a127ffe-1f8b-46d7-bc51-4331e54a539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac5fd085-55e2-42f7-9396-326954aaf382', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f75df4-beaa-482a-8761-41789db3f01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:00 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume volume-ac5fd085-55e2-42f7-9396-326954aaf382 (ac5fd085-55e2-42f7-9396-326954aaf382): created successfully Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f75df4-beaa-482a-8761-41789db3f01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (4e055a53-9225-4577-b2ea-f0f2b2aef474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-a3029c6c-501f-4469-aeca-ebbb1f6ab68d" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Deleting offline snapshot a3029c6c-501f-4469-aeca-ebbb1f6ab68d of volume 04c82d23-eedc-4c9b-a024-a9326d12885a {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] snapshot_file for this snap is: volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:17:00 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e1fa5aa6-7b91-4560-b8a5-b959a021e341 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created volume successfully. Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[0479c007-a6ed-4500-82b8-bd2ede1f2157]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:00 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d Apr 24 17:17:00 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:00 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb 1073741824" returned: 0 in 0.694s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:00 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d" returned: 0 in 0.608s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04c82d23-eedc-4c9b-a024-a9326d12885a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d76ece-51ed-4453-8d57-e3970786b813]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:00 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:00 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb Apr 24 17:17:00 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:00 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a Apr 24 17:17:00 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:01 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb" returned: 0 in 0.468s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.277s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:01 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Cloning volume a04de4f3-650c-497b-908c-8af9c41a7b6d to volume ab57d624-2932-4160-af9e-4e4cd8d37b40 Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751428b4-0322-4819-a2c4-6b2b09ad594a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e6c228-b465-4e9f-bf7a-ff591864d276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Creating offline snapshot 64a69ceb-9edf-4368-a475-752a93a92903 of volume a04de4f3-650c-497b-908c-8af9c41a7b6d {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:17:01 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:01 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Volume volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb (6e34fcb9-1d14-4f80-ade4-118516fc6cdb): created successfully Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e6c228-b465-4e9f-bf7a-ff591864d276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Flow 'volume_create_manager' (a1a8315c-7566-468a-b032-cd748afb6483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[df129f43-0be5-4781-a93a-0fd50fca283e]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a" returned: 0 in 0.598s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:01 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-bbdfb026-5b9a-4925-93c7-dcde2e56b548 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created volume successfully. Apr 24 17:17:01 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d Apr 24 17:17:01 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:01 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d Apr 24 17:17:01 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-6e34fcb9-1d14-4f80-ade4-118516fc6cdb-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-6e34fcb9-1d14-4f80-ade4-118516fc6cdb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-quobyte-6e34fcb9-1d14-4f80-ade4-118516fc6cdb" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-6e34fcb9-1d14-4f80-ade4-118516fc6cdb" acquired by "delete_volume" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[381f27dc-0224-4622-b52c-cf1d30e1848f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:01 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:01 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb Apr 24 17:17:01 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:02 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d" returned: 0 in 0.578s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:02 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 1G Apr 24 17:17:02 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:02 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d" returned: 0 in 0.634s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:02 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d Apr 24 17:17:02 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:02 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb" returned: 0 in 0.577s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:02 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb Apr 24 17:17:02 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:02 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a.a3029c6c-501f-4469-aeca-ebbb1f6ab68d" returned: 0 in 0.508s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-a3029c6c-501f-4469-aeca-ebbb1f6ab68d" released by "_delete_snapshot" :: held 2.466s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-04c82d23-eedc-4c9b-a024-a9326d12885a" released by "delete_snapshot" :: held 2.522s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Created reservations ['23ce3cac-f6f4-43dd-b870-7a3b03d170a7', '91eddc68-27c5-43ed-babb-48f5ac431e91', '3a343747-09aa-4cd3-905a-e84885b0c39e', '14e96f92-5658-461a-adc8-ff7d8366228c'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:02 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Delete snapshot completed successfully. Apr 24 17:17:02 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 1G" returned: 0 in 0.760s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a04de4f3-650c-497b-908c-8af9c41a7b6d -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-df81e300-23f7-4cba-84ad-e7674ce3546d tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-a3029c6c-501f-4469-aeca-ebbb1f6ab68d-delete_snapshot" released by "delete_snapshot" :: held 2.707s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:02 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a04de4f3-650c-497b-908c-8af9c41a7b6d -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 Apr 24 17:17:02 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:02 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6e34fcb9-1d14-4f80-ade4-118516fc6cdb" returned: 0 in 0.568s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_service.periodic_task [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81986) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-6e34fcb9-1d14-4f80-ade4-118516fc6cdb" released by "delete_volume" :: held 1.203s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:02 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:02 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:02 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created reservations ['4765ce46-08e0-4d39-a2e8-55584b725b43', '4d79ff6e-b3e0-450b-bf4a-cff85fa930ea', 'b70a63f7-acb0-4ed8-8dc6-26513ed6f526', 'a62282ea-9844-44fe-acd7-46ade08eadb5'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:03 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:03 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-04c82d23-eedc-4c9b-a024-a9326d12885a-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-04c82d23-eedc-4c9b-a024-a9326d12885a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "cinder-quobyte-04c82d23-eedc-4c9b-a024-a9326d12885a" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-04c82d23-eedc-4c9b-a024-a9326d12885a" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[455b77f9-e296-478f-90e8-5928c67b196e]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:03 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a04de4f3-650c-497b-908c-8af9c41a7b6d -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903" returned: 0 in 0.645s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:03 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 is being set with open permissions: ugo+rw Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:03 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 Apr 24 17:17:03 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:03 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.568s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a754c82e-bdfc-4a96-af09-07757a4e894e None None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:03 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a Apr 24 17:17:03 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:03 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.567s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:03 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Deleted volume successfully. Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-a8b1fbd1-376c-4c48-8cd9-b65927c1f6bf tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-6e34fcb9-1d14-4f80-ade4-118516fc6cdb-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-ac5fd085-55e2-42f7-9396-326954aaf382-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-ac5fd085-55e2-42f7-9396-326954aaf382-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-quobyte-ac5fd085-55e2-42f7-9396-326954aaf382" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-ac5fd085-55e2-42f7-9396-326954aaf382" acquired by "delete_volume" :: waited 0.017s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:03 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903" returned: 0 in 0.534s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[76115ff9-0755-4de3-8df9-36ba911df844]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:03 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:04 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a" returned: 0 in 0.600s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:04 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.info Apr 24 17:17:04 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:04 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a Apr 24 17:17:04 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:04 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382 Apr 24 17:17:04 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:04 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.info" returned: 0 in 0.494s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:04 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.info is being set with open permissions: ugo+rw Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:04 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-04c82d23-eedc-4c9b-a024-a9326d12885a" returned: 0 in 0.493s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:04 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.info Apr 24 17:17:04 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-quobyte-04c82d23-eedc-4c9b-a024-a9326d12885a" released by "delete_volume" :: held 1.158s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:04 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382" returned: 0 in 0.585s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Created reservations ['930e92b4-7640-4e16-939f-d60da07e0f2f', '8c851a9a-f72c-47f7-802e-0ffe45b9e47c', 'ac00f1bb-59ac-47b2-a7e5-b5e06b896221', '81b41e49-47bb-46d6-ae5d-9d6873e8f008'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:04 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382 Apr 24 17:17:04 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:04 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:04 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:04 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:05 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.info" returned: 0 in 0.509s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-quobyte-ab57d624-2932-4160-af9e-4e4cd8d37b40" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:05 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ac5fd085-55e2-42f7-9396-326954aaf382" returned: 0 in 0.462s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-ab57d624-2932-4160-af9e-4e4cd8d37b40" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] snapshot: 64a69ceb-9edf-4368-a475-752a93a92903, volume: ab57d624-2932-4160-af9e-4e4cd8d37b40, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-ac5fd085-55e2-42f7-9396-326954aaf382" released by "delete_volume" :: held 1.126s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4aa4f1-5d3e-4a9e-ab20-75a355d9291b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created reservations ['a8b76554-7ec8-4789-a607-32c1d4d621a4', '0bfdda03-9f19-4091-98da-d44ed9dfdbb8', '137e4a8c-0a67-4b56-97cb-f5b7cecc05bf', '0d8c75ed-285b-4a71-8bb7-63e617c5ff90'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:05 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 Apr 24 17:17:05 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:05 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.500s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:05 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Deleted volume successfully. Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-42cd3602-441c-46c5-a8d8-89917d07f02e tempest-CreateVolumesFromSnapshotTest-848436155 None] Lock "cinder-04c82d23-eedc-4c9b-a024-a9326d12885a-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:05 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:05 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:05 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903" returned: 0 in 0.586s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a04de4f3-650c-497b-908c-8af9c41a7b6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[628636db-c20a-47b9-8f6c-31451bbf6477]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:05 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.496s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:05 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Deleted volume successfully. Apr 24 17:17:05 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-796ff6c3-19d5-48f1-bbde-434ab05f922b tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-ac5fd085-55e2-42f7-9396-326954aaf382-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:05 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d Apr 24 17:17:05 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-quobyte-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:06 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a" acquired by "delete_volume" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:06 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8459a1b-34c1-44ff-bdae-965d7b5abb51]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:06 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a Apr 24 17:17:06 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:06 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d" returned: 0 in 0.671s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:06 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:17:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:06 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 Apr 24 17:17:06 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:06 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a" returned: 0 in 0.692s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:06 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:06 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a Apr 24 17:17:06 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:07 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:07 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a" returned: 0 in 0.995s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:07 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a" released by "delete_volume" :: held 1.761s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created reservations ['f5b490a5-eacd-473e-8147-46af8e86c9f9', 'afac8f5b-fd29-4c79-8ee8-d96ac767d7be', 'fd3c7a51-b95f-415e-a603-108d1de50f41', '05084841-7690-4c02-9dec-a40b791cfad5'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:08 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:08 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-quobyte-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59" acquired by "delete_volume" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26ae6e9-0e8c-41c4-a83d-ff55564d69fc]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:08 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:09 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59 Apr 24 17:17:09 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:09 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:09 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 1.393s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:09 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:09 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Deleted volume successfully. Apr 24 17:17:09 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4934b3d6-cdba-4d12-8b9d-8cc701ea2ace tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-26f07bd2-3627-4bd0-a74c-b0ccf82ff54a-delete_volume" released by "delete_volume" :: held 3.676s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:10 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59" returned: 0 in 1.688s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:10 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:10 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59 Apr 24 17:17:10 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:11 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59" returned: 0 in 0.938s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59" released by "delete_volume" :: held 2.740s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created reservations ['ff10ae98-8027-4766-8c1b-e77d60f62616', 'ddbf551d-6261-4868-83d6-5fb62c7d7633', 'c569681f-61ae-4162-933b-bbe52a7755bd', '9d4befaf-3ae1-4e3f-86e5-9e4fde3802bd'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:11 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:11 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:11 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40" returned: 0 in 5.375s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bdfcbd-dac6-4679-9388-d76902a3db01]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:11 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:11 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d Apr 24 17:17:11 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-a7bfb815-570e-4b04-a8e6-e683a20c68a0-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-a7bfb815-570e-4b04-a8e6-e683a20c68a0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:12 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.450s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-quobyte-a7bfb815-570e-4b04-a8e6-e683a20c68a0" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:12 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Deleted volume successfully. Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bacece27-e62a-4705-b9cd-99c45d5627b2 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-6c6ebe0a-3624-43c4-9620-a9bcc46cdc59-delete_volume" released by "delete_volume" :: held 3.566s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-a7bfb815-570e-4b04-a8e6-e683a20c68a0" acquired by "delete_volume" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa4ad00-d678-481e-b2a4-6c54871a591c]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:12 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0 Apr 24 17:17:12 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:12 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d" returned: 0 in 0.729s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:17:12 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Converted 1024.00 MB image at 190.46 MB/s Apr 24 17:17:12 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 is being set with open permissions: ugo+rw Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:12 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 Apr 24 17:17:12 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:12 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0" returned: 0 in 0.591s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:12 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0 Apr 24 17:17:12 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:12 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40" returned: 0 in 0.456s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-ab57d624-2932-4160-af9e-4e4cd8d37b40" released by "_copy_volume_from_snapshot" :: held 7.911s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-quobyte-64a69ceb-9edf-4368-a475-752a93a92903" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:12 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-64a69ceb-9edf-4368-a475-752a93a92903" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Deleting offline snapshot 64a69ceb-9edf-4368-a475-752a93a92903 of volume a04de4f3-650c-497b-908c-8af9c41a7b6d {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] snapshot_file for this snap is: volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[958cd828-66ab-422b-bf8a-e16496cae1b9]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:13 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 Apr 24 17:17:13 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:13 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a7bfb815-570e-4b04-a8e6-e683a20c68a0" returned: 0 in 0.464s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-a7bfb815-570e-4b04-a8e6-e683a20c68a0" released by "delete_volume" :: held 1.093s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created reservations ['e54b6312-136b-4495-9531-770d74a263b2', '9698f693-6307-42dd-b06f-fa30bf1036fc', 'f880d45d-ceae-4883-b06a-10917775d033', '319b1208-bf3e-4dbc-bd4f-50fe57806baf'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:13 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:13 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:13 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903" returned: 0 in 0.554s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a04de4f3-650c-497b-908c-8af9c41a7b6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c0d787-c0e6-490a-bfec-c664622bb2ee]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:13 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d Apr 24 17:17:13 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:13 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.456s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:13 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Deleted volume successfully. Apr 24 17:17:13 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-50e16f1a-b714-4d3a-81a0-ae74b729a5d9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-a7bfb815-570e-4b04-a8e6-e683a20c68a0-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:14 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d" returned: 0 in 0.522s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:14 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 Apr 24 17:17:14 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-a95a091f-3941-4521-b99a-80156e155664-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-a95a091f-3941-4521-b99a-80156e155664-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "cinder-quobyte-a95a091f-3941-4521-b99a-80156e155664" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:14 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-a95a091f-3941-4521-b99a-80156e155664" acquired by "delete_volume" :: waited 0.013s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:14 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[668d94f0-d86a-4a03-ac6f-38075d5c63ef]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:14 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664 Apr 24 17:17:14 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:14 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903" returned: 0 in 0.569s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:14 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:14 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903 Apr 24 17:17:14 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:15 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664" returned: 0 in 0.570s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:15 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664 Apr 24 17:17:15 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:15 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d.64a69ceb-9edf-4368-a475-752a93a92903" returned: 0 in 0.471s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-64a69ceb-9edf-4368-a475-752a93a92903" released by "_delete_snapshot" :: held 2.206s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.871s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 18.272s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "cinder-quobyte-3cf662c1-6277-4e28-bfc8-f843b4e41422-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" by "_create_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619550b3-ce52-412b-97f4-4d428097f130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab57d624-2932-4160-af9e-4e4cd8d37b40', 'volume_size': 1, 'source_volid': 'a04de4f3-650c-497b-908c-8af9c41a7b6d', 'source_volstatus': 'available'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d37caa6-6efa-4f08-976d-7f83c8bfda12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-3cf662c1-6277-4e28-bfc8-f843b4e41422-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Creating volume c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 from snapshot 3cf662c1-6277-4e28-bfc8-f843b4e41422 {{(pid=81986) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "cinder-quobyte-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" by "_copy_volume_from_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:15 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Volume volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 (ab57d624-2932-4160-af9e-4e4cd8d37b40): created successfully Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d37caa6-6efa-4f08-976d-7f83c8bfda12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Flow 'volume_create_manager' (edbec9a3-c6cc-42b9-a975-e774efaddf5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] snapshot: 3cf662c1-6277-4e28-bfc8-f843b4e41422, volume: c12c2398-17a8-4a2a-bad5-7b86ca7ddf66, {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc6f55f-24ff-4fa5-835a-e555075f5c78]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:15 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ae6ad616-938c-4c5b-aa91-c8f243e238d3 tempest-VolumeDependencyTests-960558612 None] Created volume successfully. Apr 24 17:17:15 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 Apr 24 17:17:15 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:15 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a95a091f-3941-4521-b99a-80156e155664" returned: 0 in 0.492s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-quobyte-a95a091f-3941-4521-b99a-80156e155664" released by "delete_volume" :: held 1.104s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Created reservations ['0c142d80-6b25-4490-83b3-7a684514e262', '01963c8c-2e43-4808-ad65-e9b70f1aa15e', '2b1d0f4b-5b16-4bd3-8f8f-336feb74cbcc', '6c95bd7c-55ce-4c84-9c6b-0596fcda1452'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:15 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:15 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-a04de4f3-650c-497b-908c-8af9c41a7b6d-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-a04de4f3-650c-497b-908c-8af9c41a7b6d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-quobyte-a04de4f3-650c-497b-908c-8af9c41a7b6d" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-a04de4f3-650c-497b-908c-8af9c41a7b6d" acquired by "delete_volume" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc04f7c0-6cba-43bf-a422-decdda27b6b6]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:15 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d Apr 24 17:17:15 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:15 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422" returned: 0 in 0.607s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9df06f54-9543-4646-87a7-492f83caa583(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Creating direct copy from snapshot {{(pid=81986) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caba7f0-58fe-45ad-8428-45c6e782efc7]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:15 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:16 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 Apr 24 17:17:16 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:16 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.510s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:16 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Deleted volume successfully. Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=166,cinder:UPDATE=220,cinder:INSERT=57,cinder:DELETE=19 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-520f7685-c441-475f-ab3c-57d87a1679a9 tempest-CreateVolumesFromSourceVolumeTest-1402487338 None] Lock "cinder-a95a091f-3941-4521-b99a-80156e155664-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:16 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d" returned: 0 in 0.564s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:16 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d Apr 24 17:17:16 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:16 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583" returned: 0 in 0.580s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG cinder.utils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Path /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 not found in is_blk_device check {{(pid=81986) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:16 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 Apr 24 17:17:16 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:16 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-a04de4f3-650c-497b-908c-8af9c41a7b6d" returned: 0 in 0.531s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-a04de4f3-650c-497b-908c-8af9c41a7b6d" released by "delete_volume" :: held 1.151s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:16 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Created reservations ['8a01aa1f-b99f-44e7-871b-689fbdfa04a8', '4000fd96-67aa-462c-a889-bb2e40ad3873', 'de361ff6-f3b3-4fb2-bcf5-e11ec7938dce', '84ded38b-883d-4fc4-9f77-1dd3b8cb99b0'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:17 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:17 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:17 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:17 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:17 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-ab57d624-2932-4160-af9e-4e4cd8d37b40-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-ab57d624-2932-4160-af9e-4e4cd8d37b40-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-quobyte-ab57d624-2932-4160-af9e-4e4cd8d37b40" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-ab57d624-2932-4160-af9e-4e4cd8d37b40" acquired by "delete_volume" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:18 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[87867c43-69ee-4720-b66e-35bcc049a294]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:18 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:18 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 1.150s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:18 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:18 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Deleted volume successfully. Apr 24 17:17:18 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-23724d5e-5df9-4697-ae32-90683f77fcf1 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-a04de4f3-650c-497b-908c-8af9c41a7b6d-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:18 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 Apr 24 17:17:18 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:19 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40" returned: 0 in 0.928s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:19 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:19 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40 Apr 24 17:17:19 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-ab57d624-2932-4160-af9e-4e4cd8d37b40" returned: 0 in 1.054s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:20 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-ab57d624-2932-4160-af9e-4e4cd8d37b40" released by "delete_volume" :: held 2.065s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Created reservations ['e25da380-340b-4217-8ec0-e2ed62103253', 'b63a4fc0-0ca6-4f02-9fe6-fb21c6dc1fd2', '5e73e3f0-f98b-4d57-869e-db4da7787afb', '571795ff-a471-47fa-9275-281920b90cdb'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:20 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:20 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-835bf2bc-bfec-473a-8910-0e4356bd9e83-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Lock "cinder-835bf2bc-bfec-473a-8910-0e4356bd9e83-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Acquiring lock "cinder-quobyte-835bf2bc-bfec-473a-8910-0e4356bd9e83" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:20 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-835bf2bc-bfec-473a-8910-0e4356bd9e83" acquired by "delete_volume" :: waited 0.040s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc78a5e-2836-4b1f-81de-264d025ca54b]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:21 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 Apr 24 17:17:21 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Flow 'volume_create_manager' (25e1e2c7-5a99-4650-8c29-84748b5676c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b350f41f-455e-4506-8d36-84904ec2ac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:21 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 1.396s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:21 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Deleted volume successfully. Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b350f41f-455e-4506-8d36-84904ec2ac4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b124e5463342df84c7f23031429f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:17:22Z,use_quota=True,user_id='af9c945509c445de952589dffa1b0aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dccd79a-febf-4217-8715-30e9a0a059e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dccd79a-febf-4217-8715-30e9a0a059e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95122bd-a873-4d13-8ffc-0b1dc9693ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95122bd-a873-4d13-8ffc-0b1dc9693ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b3eaab-ab66-4d0b-ac5a-2600ac2775b5', 'volume_name': 'volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:21 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018bcc28-a42f-4ad4-ba4e-15d3c307aaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018bcc28-a42f-4ad4-ba4e-15d3c307aaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:22 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a11246-e776-46cd-8b7c-f643fb8f609c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:22 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Volume d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5', 'volume_size': 1} Apr 24 17:17:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:22 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fb9ae9d3-8224-40fd-9e5d-3c15c22cd723 tempest-VolumeDependencyTests-960558612 None] Lock "cinder-ab57d624-2932-4160-af9e-4e4cd8d37b40-delete_volume" released by "delete_volume" :: held 4.034s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:22 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83" returned: 0 in 1.256s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:22 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83 Apr 24 17:17:22 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:22 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" returned: 0 in 6.313s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:22 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f32f46-4c1d-4cdb-a49b-c60cb89b6d86]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:22 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:22 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 Apr 24 17:17:22 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:23 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-835bf2bc-bfec-473a-8910-0e4356bd9e83" returned: 0 in 0.751s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Lock "cinder-quobyte-835bf2bc-bfec-473a-8910-0e4356bd9e83" released by "delete_volume" :: held 2.095s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Created reservations ['0e28396b-1c82-4d7a-8164-1216297633f3', 'bae9cb6e-f1d8-4fb9-8424-b7fac8c8e921', '33fa9558-cfcb-45aa-8ac9-609ea14ca164', '570e19bf-d0a6-4145-a546-507015c38fad'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:23 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:23 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:23 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583" returned: 0 in 0.678s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG cinder.image.image_utils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Image conversion details: src /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 {{(pid=81986) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 17:17:23 devstack cinder-volume[81986]: INFO cinder.image.image_utils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Converted 1024.00 MB image at 162.17 MB/s Apr 24 17:17:23 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 is being set with open permissions: ugo+rw Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:23 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 Apr 24 17:17:23 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:23 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.455s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:23 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Deleted volume successfully. Apr 24 17:17:23 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-55f28f62-85d0-4249-bd57-11cf8ae5b74a tempest-VolumeDependencyTests-960558612 None] Lock "cinder-835bf2bc-bfec-473a-8910-0e4356bd9e83-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:24 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" returned: 0 in 0.444s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" released by "_copy_volume_from_snapshot" :: held 8.719s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-3cf662c1-6277-4e28-bfc8-f843b4e41422-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" released by "_create_volume_from_snapshot" :: held 8.760s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.792s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.015s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b124e5463342df84c7f23031429f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:17:22Z,use_quota=True,user_id='af9c945509c445de952589dffa1b0aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Creating volume d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5 {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:17:24 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:24 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5 1073741824 Apr 24 17:17:24 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c6f2b8-f854-4c25-bfe7-2e23207ba29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66', 'volume_size': 1, 'snapshot_id': '3cf662c1-6277-4e28-bfc8-f843b4e41422'}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc515f5e-4969-4cfc-95f8-83b938d0b8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:24 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Volume volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 (c12c2398-17a8-4a2a-bad5-7b86ca7ddf66): created successfully Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc515f5e-4969-4cfc-95f8-83b938d0b8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Flow 'volume_create_manager' (a0bed695-ea72-44e5-940a-1dcb2099c262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:17:24 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-4469e70a-cb0e-4f75-bd86-298d4b2cd302 tempest-SnapshotDependencyTests-1405310532 None] Created volume successfully. Apr 24 17:17:24 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5 1073741824" returned: 0 in 0.688s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:24 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:24 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5 Apr 24 17:17:24 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:25 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5" returned: 0 in 0.520s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a11246-e776-46cd-8b7c-f643fb8f609c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9887b9a8-7078-4450-bf1f-a58becf239cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:25 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Volume volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5 (d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5): created successfully Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9887b9a8-7078-4450-bf1f-a58becf239cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Flow 'volume_create_manager' (25e1e2c7-5a99-4650-8c29-84748b5676c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "cinder-3cf662c1-6277-4e28-bfc8-f843b4e41422-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:25 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-2c5147e4-a860-42a0-af06-bde97094d8bd tempest-CinderUnicodeTest-340535378 None] Created volume successfully. Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-3cf662c1-6277-4e28-bfc8-f843b4e41422-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "cinder-quobyte-9df06f54-9543-4646-87a7-492f83caa583" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-9df06f54-9543-4646-87a7-492f83caa583" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "cinder-quobyte-3cf662c1-6277-4e28-bfc8-f843b4e41422" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-3cf662c1-6277-4e28-bfc8-f843b4e41422" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Deleting offline snapshot 3cf662c1-6277-4e28-bfc8-f843b4e41422 of volume 9df06f54-9543-4646-87a7-492f83caa583 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] snapshot_file for this snap is: volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0fd227-af8a-4ce7-9f1a-4745c0526439]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:25 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:25 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 Apr 24 17:17:25 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:26 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422" returned: 0 in 0.606s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9df06f54-9543-4646-87a7-492f83caa583(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[d260f260-049b-4d54-ac8e-447dec7b7052]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.flows.manager.create_volume [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81986) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Flow 'volume_create_manager' (8e0e4d13-3cf8-4f12-b59f-0cdd56a6a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92e17ed-0fd9-4529-acdb-a0a104ba9487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:26 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 Apr 24 17:17:26 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92e17ed-0fd9-4529-acdb-a0a104ba9487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:17:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1330130232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b9254f-f55f-4c1e-9554-e88558f1ae0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b124e5463342df84c7f23031429f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:17:26Z,use_quota=True,user_id='af9c945509c445de952589dffa1b0aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b54f6d2-1344-4da6-8d3d-63adcb01a357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b54f6d2-1344-4da6-8d3d-63adcb01a357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf3d8bf-2a78-4eb5-968c-781581d7c229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf3d8bf-2a78-4eb5-968c-781581d7c229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b9254f-f55f-4c1e-9554-e88558f1ae0e', 'volume_name': 'volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ac115c-31ae-453b-9db0-e1c09c69bc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ac115c-31ae-453b-9db0-e1c09c69bc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f552ad25-afc6-4d9b-8402-26f25a6135f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:26 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Volume 98b9254f-f55f-4c1e-9554-e88558f1ae0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e', 'volume_size': 1} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T15:17:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1330130232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b9254f-f55f-4c1e-9554-e88558f1ae0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b124e5463342df84c7f23031429f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T15:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T15:17:26Z,use_quota=True,user_id='af9c945509c445de952589dffa1b0aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7312263-304c-4bff-958e-c49aaa37ad35),volume_type_id=c7312263-304c-4bff-958e-c49aaa37ad35)}" {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Creating volume 98b9254f-f55f-4c1e-9554-e88558f1ae0e {{(pid=81986) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Selected osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 as target Quobyte volume. {{(pid=81986) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 17:17:26 devstack cinder-volume[81986]: INFO cinder.volume.drivers.remotefs [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] casted to osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766 Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e 1073741824 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:26 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e 1073741824 Apr 24 17:17:26 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:26 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583" returned: 0 in 0.605s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:26 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 Apr 24 17:17:26 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:26 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e 1073741824" returned: 0 in 0.597s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:26 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:26 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e Apr 24 17:17:26 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:27 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422" returned: 0 in 0.554s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:27 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422 Apr 24 17:17:27 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:27 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e" returned: 0 in 0.479s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'} {{(pid=81986) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f552ad25-afc6-4d9b-8402-26f25a6135f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e', 'volume_size': 1}' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1480dca-ef20-497e-80ba-1cf61c08a7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 17:17:27 devstack cinder-volume[81986]: INFO cinder.volume.flows.manager.create_volume [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Volume volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e (98b9254f-f55f-4c1e-9554-e88558f1ae0e): created successfully Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1480dca-ef20-497e-80ba-1cf61c08a7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81986) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Flow 'volume_create_manager' (8e0e4d13-3cf8-4f12-b59f-0cdd56a6a24a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81986) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 17:17:27 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-699b8fd9-05cb-4f79-8d5b-880b988c0ca5 tempest-CinderUnicodeTest-340535378 None] Created volume successfully. Apr 24 17:17:27 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583.3cf662c1-6277-4e28-bfc8-f843b4e41422" returned: 0 in 0.475s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-3cf662c1-6277-4e28-bfc8-f843b4e41422" released by "_delete_snapshot" :: held 2.368s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-9df06f54-9543-4646-87a7-492f83caa583" released by "delete_snapshot" :: held 2.395s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Created reservations ['7797eb61-8c8e-4bfd-a5bf-61083c73b8fb', '66915376-5b1b-4fd9-8a18-62e502af5daf', '20f47c45-14f6-4dd4-b764-033a05232151', '5c2cc891-4035-42f4-af71-8aec5fbc96c5'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:27 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Delete snapshot completed successfully. Apr 24 17:17:27 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-ac60f3a6-9064-4ebe-a0da-067d445f9cb2 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-3cf662c1-6277-4e28-bfc8-f843b4e41422-delete_snapshot" released by "delete_snapshot" :: held 2.544s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "cinder-9df06f54-9543-4646-87a7-492f83caa583-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:28 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] Creating offline snapshot 30de0932-226b-4c79-916d-4730322684ca of volume 98b9254f-f55f-4c1e-9554-e88558f1ae0e {{(pid=81986) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 17:17:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-9df06f54-9543-4646-87a7-492f83caa583-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad87d3aa-5570-479a-ab28-653c4e359fc5]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "cinder-quobyte-9df06f54-9543-4646-87a7-492f83caa583" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:28 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-9df06f54-9543-4646-87a7-492f83caa583" acquired by "delete_volume" :: waited 0.015s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:28 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e Apr 24 17:17:28 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:28 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[0720af62-c725-4ca7-8be4-604af1163038]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:28 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:28 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 Apr 24 17:17:28 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:29 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e" returned: 0 in 0.542s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca 1G {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:29 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca 1G Apr 24 17:17:29 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:29 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583" returned: 0 in 0.548s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:29 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583 Apr 24 17:17:29 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:29 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-9df06f54-9543-4646-87a7-492f83caa583" returned: 0 in 0.473s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-9df06f54-9543-4646-87a7-492f83caa583" released by "delete_volume" :: held 1.079s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:29 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca 1G" returned: 0 in 0.604s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:29 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca Apr 24 17:17:29 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Created reservations ['bebee31e-4ef8-43a2-9b1e-903ae27bd235', 'a4eb9fa8-dcee-45ed-a87d-fa92c2999ecc', 'e8371ab8-8158-4bfc-ab12-772b2c58c397', '65ea6b5a-531c-4532-bf30-ba7ec1e4499a'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:29 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:29 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:29 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:30 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e -F qcow2 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca" returned: 0 in 0.506s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:30 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca is being set with open permissions: ugo+rw Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:30 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca Apr 24 17:17:30 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:30 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.453s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:30 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Deleted volume successfully. Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-bb02d799-7b92-48ed-b9b4-9b0d70b82ab2 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-9df06f54-9543-4646-87a7-492f83caa583-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:30 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca" returned: 0 in 0.503s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "cinder-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:30 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.info Apr 24 17:17:30 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "cinder-quobyte-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf675c2-3688-4b68-b266-13dad5b9ab7f]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:30 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:30 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 Apr 24 17:17:30 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:31 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.info" returned: 0 in 0.526s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:31 devstack cinder-volume[81986]: WARNING cinder.volume.drivers.remotefs [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.info is being set with open permissions: ugo+rw Apr 24 17:17:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.info {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:31 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.info Apr 24 17:17:31 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:31 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" returned: 0 in 0.597s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:31 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66 Apr 24 17:17:31 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:31 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.info" returned: 0 in 0.455s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.271s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:31 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-d7cdd0ea-024d-414c-86b5-f85c19391f3b tempest-CinderUnicodeTest-340535378 None] Create snapshot completed successfully Apr 24 17:17:31 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:31 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" returned: 0 in 0.475s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:31 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-quobyte-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66" released by "delete_volume" :: held 1.112s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:31 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Created reservations ['141c302c-6af7-47a2-8f13-938652f0e5e6', 'f0783794-2ab6-4d9f-8d59-0a002e3009b7', 'af497996-ab30-4aec-ae24-5b4f62adae94', '578fcb04-3ce0-4ca3-84ab-07b1d6a8eccb'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:32 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:32 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:32 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.436s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:32 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Deleted volume successfully. Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-fcad01fa-766e-4274-8b98-31a07773d862 tempest-SnapshotDependencyTests-1405310532 None] Lock "cinder-c12c2398-17a8-4a2a-bad5-7b86ca7ddf66-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Acquiring lock "cinder-30de0932-226b-4c79-916d-4730322684ca-delete_snapshot" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-30de0932-226b-4c79-916d-4730322684ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Acquiring lock "cinder-quobyte-98b9254f-f55f-4c1e-9554-e88558f1ae0e" by "delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-quobyte-98b9254f-f55f-4c1e-9554-e88558f1ae0e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Acquiring lock "cinder-quobyte-30de0932-226b-4c79-916d-4730322684ca" by "_delete_snapshot" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-quobyte-30de0932-226b-4c79-916d-4730322684ca" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Deleting offline snapshot 30de0932-226b-4c79-916d-4730322684ca of volume 98b9254f-f55f-4c1e-9554-e88558f1ae0e {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] snapshot_file for this snap is: volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca {{(pid=81986) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b861677-0904-4316-aec5-92dd0632d969]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:32 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:32 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca Apr 24 17:17:32 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:33 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca" returned: 0 in 0.574s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:33 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.remotefs [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81986) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 17:17:33 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[2928972c-15ea-4026-a5d5-25aa762547d7]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:33 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e Apr 24 17:17:33 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:33 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e" returned: 0 in 0.581s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:33 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:34 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca Apr 24 17:17:34 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:34 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca" returned: 0 in 0.614s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:34 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:34 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca Apr 24 17:17:34 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:35 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:35 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e.30de0932-226b-4c79-916d-4730322684ca" returned: 0 in 0.511s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-quobyte-30de0932-226b-4c79-916d-4730322684ca" released by "_delete_snapshot" :: held 2.419s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-quobyte-98b9254f-f55f-4c1e-9554-e88558f1ae0e" released by "delete_snapshot" :: held 2.445s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:35 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Created reservations ['849c2d63-a084-40aa-956d-3db4438a3d3e', '8ae1f5ee-8c86-4978-89e3-5be902512ff9', '9da14f9a-11b3-44f0-8b3d-b48c8cbe607f', '45320a81-e561-4fbe-a9e0-c55238341db2'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:35 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Delete snapshot completed successfully. Apr 24 17:17:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-e63adc53-9e72-4efc-af9a-45428fb3b564 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-30de0932-226b-4c79-916d-4730322684ca-delete_snapshot" released by "delete_snapshot" :: held 2.591s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Acquiring lock "cinder-98b9254f-f55f-4c1e-9554-e88558f1ae0e-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-98b9254f-f55f-4c1e-9554-e88558f1ae0e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Acquiring lock "cinder-quobyte-98b9254f-f55f-4c1e-9554-e88558f1ae0e" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:35 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-quobyte-98b9254f-f55f-4c1e-9554-e88558f1ae0e" acquired by "delete_volume" :: waited 0.024s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:36 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9d7191-7d32-46ea-8b0e-05684b13fc00]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:36 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e Apr 24 17:17:36 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:36 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e" returned: 0 in 0.626s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:36 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:36 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e Apr 24 17:17:36 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:37 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-98b9254f-f55f-4c1e-9554-e88558f1ae0e" returned: 0 in 0.506s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-quobyte-98b9254f-f55f-4c1e-9554-e88558f1ae0e" released by "delete_volume" :: held 1.204s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Created reservations ['84c8d841-799b-475c-9d73-017ada4bd227', 'ec51cb98-90a0-48bf-bd68-b4cc8ab4b137', 'a4c8551c-99ad-4da9-bbab-1ca3b748005b', '09a520a5-3ec7-448a-bd35-8e8b3454e990'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:37 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:37 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:37 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.491s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:37 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Deleted volume successfully. Apr 24 17:17:37 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-46fb87de-757d-4cae-9123-fb334059f8f0 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-98b9254f-f55f-4c1e-9554-e88558f1ae0e-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Acquiring lock "cinder-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5-delete_volume" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Acquiring lock "cinder-quobyte-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5" by "delete_volume" {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 17:17:38 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-quobyte-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5" acquired by "delete_volume" :: waited 0.020s {{(pid=81986) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 17:17:38 devstack cinder-volume[81986]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a83a810-ec5f-4e8a-a4b1-b82cf8554f2a]: (4, 'qcow2') {{(pid=83213) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 17:17:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:38 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5 Apr 24 17:17:38 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:38 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5" returned: 0 in 0.563s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:38 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5 {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:38 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5 Apr 24 17:17:38 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:39 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a/volume-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5" returned: 0 in 0.577s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:39 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-quobyte-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5" released by "delete_volume" :: held 1.184s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:39 devstack cinder-volume[81986]: DEBUG cinder.quota [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Created reservations ['82ba55c7-e5b7-4719-b2c0-2aa8b62a8e19', '2b152385-d25f-4642-9ce0-1f619e28fc3b', 'c3bbd17f-450d-440e-90d3-b80c6e8a88aa', '11196a94-de52-4607-b194-2857ab515308'] {{(pid=81986) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 17:17:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 17:17:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 17:17:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766': None} {{(pid=81986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 17:17:39 devstack cinder-volume[81986]: DEBUG cinder.volume.drivers.quobyte [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0f7f2da-0a43-4f40-be2d-95744b06c766'] {{(pid=81986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 17:17:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.lockutils [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81986) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 17:17:39 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 17:17:39 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a Apr 24 17:17:39 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 17:17:40 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Apr 24 17:17:40 devstack cinder-volume[81986]: DEBUG oslo_concurrency.processutils [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6409a6d8bc19f4e3531fe4f2c0f5734a" returned: 0 in 0.500s {{(pid=81986) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 17:17:40 devstack cinder-volume[81986]: DEBUG cinder.manager [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Notifying Schedulers of capabilities ... {{(pid=81986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 17:17:40 devstack cinder-volume[81986]: INFO cinder.volume.manager [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Deleted volume successfully. Apr 24 17:17:40 devstack cinder-volume[81986]: DEBUG cinder.coordination [None req-f5f2a53c-6247-443e-84a1-d89235c8bae0 tempest-CinderUnicodeTest-340535378 None] Lock "cinder-d3b3eaab-ab66-4d0b-ac5a-2600ac2775b5-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=81986) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 17:17:49 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:UPDATE=169,cinder:SELECT=103,cinder:INSERT=30,cinder:DELETE=10 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 17:17:50 devstack cinder-volume[81986]: DEBUG dbcounter [-] [81986] Writing DB stats cinder:SELECT=51,cinder:INSERT=24,cinder:UPDATE=77,cinder:DELETE=8 {{(pid=81986) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}